Light field display system based amusement park attraction

ABSTRACT

A light filed (LF) display system for displaying holographic content to viewers in an amusement park (e.g., as part of an amusement park ride). The LF display system in an amusement park includes LF display modules tiled together to form an array of LF modules. In some embodiments, the LF display system includes a tracking system and/or a viewer profiling module. The tracking system and viewer profiling module can monitor and store characteristics of viewers on the amusement park ride, a viewer profile describing a viewer, and/or responses of viewers to the holographic content during the amusement park ride. The holographic content created for display on an amusement park ride can be based on any of the monitored or stored information.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. Provisional Application Ser.No. 62/703,410, entitled “Light Field Display System Based AmusementPark Attraction”, filed Jul. 25, 2018, which is incorporated byreference in its entirety.

This application is related to International Application Nos.PCT/US2017/042275, PCT/US2017/042276, PCT/US2017/042418,PCT/US2017/042452, PCT/US2017/042462, PCT/US2017/042466,PCT/US2017/042467, PCT/US2017/042468, PCT/US2017/042469,PCT/US2017/042470, and PCT/US2017/042679, all of which are incorporatedby reference herein in their entirety.

BACKGROUND

The present disclosure relates to amusement park attractions, andspecifically relates to light field display based amusement parkattractions.

Conventional amusement park attractions (also referred to as rides)generally rely on physical props/décor, animatronics, andtwo-dimensional (2D) visual content for immersing viewers in theamusement park rides. However, physical props/décor and animatronicsrequire extensive time and effort to set up and maintain. In order tochange an amusement park ride, teams of workers may replace nearly allthe physical props/décor and animatronics with new physical props/décorand new animatronics for the new ride. Moreover, the complexity ofanimatronics further requires excess time and effort for maintenance.Although presenting two-dimensional (2D) visual content is easilyinterchangeable, 2D content is limited in its ability to provide animmersive experience required of an amusement park ride.

SUMMARY

A light field (LF) display system for displaying holographic content toviewers of an amusement park (e.g., an amusement park ride or anamusement park queue). In some embodiments, the LF display systemincludes LF display modules that form a surface (e.g., wall, ceiling,floor, control panel, etc.) on the amusement park ride. In someembodiments, the LF display system includes LF display modules placed oneither or both sides of an amusement park queue. As viewers wait in thequeue, the LF display modules present holographic content to viewers inthe queue. The LF display modules each have a display area and may betiled together to form a seamless display surface that has an effectivedisplay area that is larger than the display area of the individual LFdisplay module.

For example, in some embodiments, a LF display system comprises acontroller configured to generate holographic content and a LF displayassembly. The LF display assembly comprises one or more LF displaymodules that are configured to present the holographic content in aholographic object volume to one or more viewers located in a viewingvolume of the one or more LF display modules of an amusement park ride.

In another example, in some embodiments, a LF display system comprises acontroller configured to generate holographic content and a LF displayassembly. The LF display assembly comprises one or more LF displaymodules that are configured to present the holographic content in aholographic object volume to one or more viewers located in a viewingvolume of the one or more LF display modules of an amusement park queue.

In some embodiments, the LF display system includes a tracking systemand/or a viewer profiling module. The tracking system and viewerprofiling module can monitor and store characteristics of viewers on theamusement park ride, a viewer profile describing a viewer, and/orresponses of viewers to the holographic content during the amusementpark ride. The holographic content created for display on an amusementpark ride can be based on any of the monitored or stored information.

In some embodiments, a user may interact with the holographic content,and the interaction can act as input for the holographic contentcreation system. For example, in some embodiments, some or all of the LFdisplay system includes a plurality of ultrasonic speakers. Theplurality of ultrasonic speakers may be configured to generate a hapticsurface that coincides with at least a portion of the holographiccontent. The tracking system is configured to track an interaction of auser with the holographic object (e.g., via images captured by imagingsensors of the LF display modules and/or some other cameras). And the LFdisplay system is configured to provide to create holographic contentbased on the interaction

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram of a light field display module presenting aholographic object, in accordance with one or more embodiments.

FIG. 2A is a cross section of a portion of a light field display module,in accordance with one or more embodiments.

FIG. 2B is a cross section of a portion of a light field display module,in accordance with one or more embodiments.

FIG. 3A is a perspective view of a light field display module, inaccordance with one or more embodiments.

FIG. 3B is a cross-sectional view of a light field display module whichincludes interleaved energy relay devices, in accordance with one ormore embodiments.

FIG. 4A is a perspective view of portion of a light field display systemthat is tiled in two dimensions to form a single-sided seamless surfaceenvironment, in accordance with one or more embodiments.

FIG. 4B is a perspective view of a portion of light field display systemin a multi-sided seamless surface environment, in accordance with one ormore embodiments.

FIG. 4C is a top-down view of a light field display system with anaggregate surface in a winged configuration, in accordance with one ormore embodiments.

FIG. 4D is a side view of a light field display system with an aggregatesurface in a sloped configuration, in accordance with one or moreembodiments.

FIG. 4E is a top-down view of a light field display system with anaggregate surface on a front wall of a room, in accordance with one ormore embodiments.

FIG. 4F is a side view of a side view of a LF display system with anaggregate surface on the front wall of the room, in accordance with oneor more embodiments.

FIG. 5 is a block diagram of a light field display system, in accordancewith one or more embodiments.

FIG. 6A is an illustration of a light field display system implementedas part of an amusement park ride presenting holographic content to oneor more viewers, in accordance with one or more embodiments.

FIG. 6B is an illustration of a light field display system in acylindrical geometry that is implemented as part of an amusement parkride presenting holographic content to one or more viewers, inaccordance with one or more embodiments.

FIG. 7 is an illustration of a light field display system implemented aspart of a queue to an amusement park ride presenting content to one ormore viewers in the queue, in accordance with one or more embodiments.

FIG. 8A is an illustration of a light field display system implementedas part of an amusement park ride presenting holographic content to oneor more viewers, in accordance with one or more embodiments.

FIG. 8B is an illustration of a portion of the light field displaysystem of FIG. 8A, in accordance with one or more embodiments.

The figures depict various embodiments of the present invention forpurposes of illustration only. One skilled in the art will readilyrecognize from the following discussion that alternative embodiments ofthe structures and methods illustrated herein may be employed withoutdeparting from the principles of the invention described herein.

DETAILED DESCRIPTION Overview

A light field (LF) display system is implemented in an amusement parkride to present viewers of the amusement park ride with holographiccontent which includes at least one holographic object. The LF displaysystem comprises a LF display assembly configured to present holographiccontent including one or more holographic objects that would be visibleto one or more users in a viewing volume of the amusement park ride. Aholographic object may also be augmented with other sensory stimuli(e.g., tactile, audio, or smell). For example, ultrasonic emitters inthe LF display system may emit ultrasonic pressure waves that provide atactile surface for some or all of the holographic object. Holographiccontent may include additional visual content (i.e., 2D or 3D visualcontent). The coordination of emitters to ensure that a cohesiveexperience is enabled is part of the system in multi-emitterimplementations (i.e., holographic objects providing the correct hapticfeel and sensory stimuli at any given point in time.) The LF displayassembly may include one or more LF display modules for generating theholographic content.

In some embodiments, the LF display system may include elements thatenable the system to simultaneously emit at least one type of energy,and, simultaneously, absorb at least one type of energy for the purposeof responding to the viewers and creating an interactive experience. Forexample, a LF display system can emit both holographic objects forviewing as well as ultrasonic waves for haptic perception, andsimultaneously absorb imaging information for tracking of viewers andother scene analysis, while also absorbing ultrasonic waves to detecttouch response by the users. As an example, such a system may project aholographic creature, which when virtually “touched” by a viewer,modifies its “behavior” in accordance with the touch stimuli. Thedisplay system components that perform energy sensing of the environmentmay be integrated into the display surface via bidirectional energyelements that both emit and absorb energy, or they may be dedicatedsensors that are separate from the display surface, such as ultrasonicspeakers and imaging capture devices such as cameras.

The LF display system may be constructed to provide differentexperiences in many embodiments of an amusement park ride with theholographic objects generated. For example, the LF display system may beimplemented to present holographic content to viewers waiting in a queueat the amusement park ride. The LF display assembly may form asingle-sided or a multi-sided seamless surface environment. For example,the LF display assembly may form a multi-sided seamless surfaceenvironment that encapsulates an enclosure of an amusement park ride.Viewers of the LF display system may enter the enclosure which may bepartially or completely transformed with holographic content generatedby the LF display system. Holographic content may augment or enhancephysical objects (e.g., chairs or benches) present in the enclosure.Moreover, viewers can freely gaze around the enclosure to view theholographic content without need of eyewear devices and/or headsets.

In some embodiments, an amusement park ride is an enclosure that viewerscan move freely through (i.e., in an unconstrained manner). Theenclosure has surfaces that are covered by LF display modules of the LFdisplay assembly. For example, in some instances some or all of thewalls, the ceiling, and the floor are covered with the LF displaymodules. The enclosure may be constructed in a variety of configurationsranging from fixed entry and exit points with controlled movement toopen areas providing a full immersive experience. The LF display systempresents holographic content to viewers as they move through theenclosure (e.g., walking or via vehicle). In some cases, the holographiccontent is presented in a manner that provides a perception of moving ina generally straight direction when in fact the viewer has moved along acurved path. The enclosure may be segmented (e.g., physically or viadisplayed holographic content) to provide holographic content to viewerswithin various portions of the enclosure. The LF display system mayreceive input through a tracking system and/or a sensory feedbacksystem. Furthermore, elements of the enclosure may incorporatemechanical facilities (e.g., a moving floor, dynamic walking paths, or amotor-controlled vehicle that transports passengers) that, when combinedwith various energy emissions (e.g., light, sound, or simulated weather)alter the movement path of viewers. Based on the input, the LF displaysystem can adjust the holographic content as well as provide feedback torelated components.

The LF display system may also incorporate a system for trackingmovement of viewers at least within the viewing volume of the LF displaysystem. The tracked movement of the viewers can be used to enhance theimmersive experience of the ride. For example, the LF display system canuse the tracking information to facilitate viewer interactions with theholographic content (e.g., pushing a holographic button). The LF displaysystem can use the tracked information to monitor finger locationrelative to a holographic object. For example, the holographic objectmay be a button that can be “pushed” by a viewer. The LF display systemcan project ultrasonic energy to generate a tactile surface thatcorresponds to the button and occupies substantially the same space asthe button. The LF display system can use the tracking information todynamically move the location of the tactile surface along withdynamically moving the button as it is “pushed” by the viewer. The LFdisplay system may use the tracking information to render a holographicobject that looks at and/or make eye contact, or interacts in other wayswith the viewers. The LF display system may use the tracking informationto render a holographic object that “touches” a viewer, where ultrasonicspeakers create a tactile surface by which the holographic object caninteract, via touch, with a viewer.

Additionally, the LF display system may incorporate a viewer profilingmodule for identifying each viewer to provide personalized content toeach viewer. The viewer profiling module may further record otherinformation on the viewer's visit to the amusement park ride which canbe used on a subsequent visit for personalizing holographic content.

Light Field Display System

FIG. 1 is a diagram 100 of a light field (LF) display module 110presenting a holographic object 120, in accordance with one or moreembodiments. The LF display module 110 is part of a light field (LF)display system. The LF display system presents holographic contentincluding at least one holographic object using one or more LF displaymodules. The LF display system can present holographic content to one ormultiple viewers. In some embodiments, the LF display system may alsoaugment the holographic content with other sensory content (e.g., touch,audio, smell, temperature, etc.). For example, as discussed below, theprojection of ultrasonic sound waves may be used to generate pressurewaves that can simulate a surface of some or all of a holographicobject. The LF display system includes one or more LF display modules110, and is discussed in detail below with regard to FIGS. 2A-5.

The LF display module 110 is a holographic display that presentsholographic objects (e.g., the holographic object 120) to one or moreviewers (e.g., viewer 140). The LF display module 110 includes an energydevice layer (e.g., an emissive electronic display or acousticprojection device) and an energy waveguide layer (e.g., optical lensarray). Additionally, the LF display module 110 may include an energyrelay layer for the purpose of combining multiple energy sources ordetectors together to form a single surface. At a high-level, the energydevice layer generates energy (e.g., holographic content) that is thendirected using the energy waveguide layer to a region in space inaccordance with one or more four-dimensional (4D) light field functions.The LF display module 110 may also project and/or sense one or moretypes of energy simultaneously. For example, LF display module 110 maybe able to project a holographic image as well as an ultrasonic tactilesurface in a viewing volume, while simultaneously detecting imaging datafrom the viewing volume as well as ultrasonic pressure. The operation ofthe LF display module 110 is discussed in more detail below with regardto FIGS. 2A-3B.

The LF display module 110 generates holographic objects within aholographic object volume 160 using one or more 4D light field functions(e.g., derived from a plenoptic function). The holographic objects canbe three-dimensional (3D), two-dimensional (2D), or some combinationthereof. Moreover, the holographic objects may be polychromatic (e.g.,full color). The holographic objects may be projected in front of thescreen plane, behind the screen plane, or split by the screen plane. Aholographic object 120 can be presented such that it is perceivedanywhere within the holographic object volume 160. A holographic objectwithin the holographic object volume 160 may appear to a viewer 140 tobe floating in space.

A holographic object volume 160 represents a volume in which holographicobjects may be perceived by a viewer 140. The holographic object volume160 can extend in front of the surface of the display area 150 (i.e.,towards the viewer 140) such that holographic objects can be presentedin front of the plane of the display area 150. Additionally, theholographic object volume 160 can extend behind the surface of thedisplay area 150 (i.e., away from the viewer 140), allowing forholographic objects to be presented as if they are behind the plane ofthe display area 150. In other words, the holographic object volume 160may include all the rays of light that originate (e.g., are projected)from a display area 150 and can converge to create a holographic object.Herein, light rays may converge at a point that is in front of thedisplay surface, at the display surface, or behind the display surface.More simply, the holographic object volume 160 encompasses all of thevolume from which a holographic object may be perceived by a viewer.

A viewing volume 130 is a volume of space from which holographic objects(e.g., holographic object 120) presented within a holographic objectvolume 160 by the LF display system are fully viewable. The holographicobjects may be presented within the holographic object volume 160, andviewed within a viewing volume 130, such that they are indistinguishablefrom actual objects. A holographic object is formed by projecting thesame light rays that would be generated from the surface of the objectwere it physically present.

In some cases, the holographic object volume 160 and the correspondingviewing volume 130 may be relatively small—such that it is designed fora single viewer. In other embodiments, as discussed in detail below withregard to, e.g., FIGS. 4A-4F, 6A-6B, and 8A-8B, the LF display modulesmay be enlarged and/or tiled to create larger holographic object volumesand corresponding viewing volumes that can accommodate a large range ofviewers (e.g., one to thousands). The LF display modules presented inthis disclosure may be built so that the full surface of the LF displaycontains holographic imaging optics, with no inactive or dead space, andwithout any need for bezels. In these embodiments, the LF displaymodules may be tiled so that the imaging area is continuous across theseam between LF display modules, and the bond line between the tiledmodules is virtually undetectable using the visual acuity of the eye.Notably, in some configurations, some portion of the display surface maynot include holographic imaging optics, although they are not describedin detail herein.

The flexible size and/or shape of a viewing volume 130 allows forviewers to be unconstrained within the viewing volume 130. For example,a viewer 140 can move to a different position within a viewing volume130 and see a different view of the holographic object 120 from thecorresponding perspective. To illustrate, referring to FIG. 1, theviewer 140 is at a first position relative to the holographic object 120such that the holographic object 120 appears to be a head-on view of adolphin. The viewer 140 may move to other locations relative to theholographic object 120 to see different views of the dolphin. Forexample, the viewer 140 may move such that he/she sees a left side ofthe dolphin, a right side of the dolphin, etc., much like if the viewer140 was looking at an actual dolphin and changed his/her relativeposition to the actual dolphin to see different views of the dolphin. Insome embodiments, the holographic object 120 is visible to all viewerswithin the viewing volume 130 that have an unobstructed line (i.e., notblocked by an object/person) of sight to the holographic object 120.These viewers may be unconstrained such that they can move around withinthe viewing volume to see different perspectives of the holographicobject 120. Accordingly, the LF display system may present holographicobjects such that a plurality of unconstrained viewers maysimultaneously see different perspectives of the holographic objects inreal-world space as if the holographic objects were physically present.

In contrast, conventional displays (e.g., stereoscopic, virtual reality,augmented reality, or mixed reality) generally require each viewer towear some sort of external device (e.g., 3-D glasses, a near-eyedisplay, or a head-mounted display) in order to see content.Additionally and/or alternatively, conventional displays may requirethat a viewer be constrained to a particular viewing position (e.g., ina chair that has fixed location relative to the display). For example,when viewing an object shown by a stereoscopic display, a viewer alwaysfocuses on the display surface, rather than on the object, and thedisplay will always present just two views of an object that will followa viewer who attempts to move around that perceived object, causingdistortions in the perception of that object. With a light fielddisplay, however, viewers of a holographic object presented by the LFdisplay system do not need to wear an external device, nor be confinedto a particular position, in order to see the holographic object. The LFdisplay system presents the holographic object in a manner that isvisible to viewers in much the same way a physical object would bevisible to the viewers, with no requirement of special eyewear, glasses,or a head-mounted accessory. Further, the viewer may view holographiccontent from any location within a viewing volume.

Notably, potential locations for holographic objects within theholographic object volume 160 are limited by the size of the volume. Inorder to increase the size of the holographic object volume 160, a sizeof a display area 150 of the LF display module 110 may be increasedand/or multiple LF display modules may be tiled together in a mannerthat forms a seamless display surface. The seamless display surface hasan effective display area that is larger than the display areas of theindividual LF display modules. Some embodiments relating to tiling LFdisplay modules are discussed below with regard to FIGS. 4A-4F, 6A-6B,and 8A-8B. As illustrated in FIG. 1, the display area 150 is rectangularresulting in a holographic object volume 160 that is a pyramid. In otherembodiments, the display area may have some other shape (e.g.,hexagonal), which also affects the shape of the corresponding viewingvolume.

Additionally, while the above discussion focuses on presenting theholographic object 120 within a portion of the holographic object volume160 that is between the LF display module 110 and the viewer 140, the LFdisplay module 110 can additionally present content in the holographicobject volume 160 behind the plane of the display area 150. For example,the LF display module 110 may make the display area 150 appear to be asurface of the ocean that the holographic object 120 is jumping out ofAnd the displayed content may be such that the viewer 140 is able tolook through the displayed surface to see marine life that is under thewater. Moreover, the LF display system can generate content thatseamlessly moves around the holographic object volume 160, includingbehind and in front of the plane of the display area 150.

FIG. 2A illustrates a cross section 200 of a portion of a LF displaymodule 210, in accordance with one or more embodiments. The LF displaymodule 210 may be the LF display module 110. In other embodiments, theLF display module 210 may be another LF display module with a differentdisplay area shape than display area 150. In the illustrated embodiment,the LF display module 210 includes an energy device layer 220, an energyrelay layer 230, and an energy waveguide layer 240. Some embodiments ofthe LF display module 210 have different components than those describedhere. For example, in some embodiments, the LF display module 210 doesnot include the energy relay layer 230. Similarly, the functions can bedistributed among the components in a different manner than is describedhere.

The display system described here presents an emission of energy thatreplicates the energy normally surrounding an object in the real world.Here, emitted energy is directed towards a specific direction from everycoordinate on the display surface. In other words, the variouscoordinates on the display surface act as projection locations foremitted energy. The directed energy from the display surface enablesconvergence of many rays of energy, which, thereby, can createholographic objects. For visible light, for example, the LF display willproject a very large number of light rays from the projection locationsthat may converge at any point in the holographic object volume so theywill appear to come from the surface of a real-world object located inthis region of space from the perspective of a viewer that is locatedfurther away than the object being projected. In this way, the LFdisplay is generating the rays of reflected light that would leave suchan object's surface from the perspective of the viewer. The viewerperspective may change on any given holographic object, and the viewerwill see a different view of that holographic object.

The energy device layer 220 includes one or more electronic displays(e.g., an emissive display such as an OLED) and one or more other energyprojection and/or energy receiving devices as described herein. The oneor more electronic displays are configured to display content inaccordance with display instructions (e.g., from a controller of a LFdisplay system). The one or more electronic displays include a pluralityof pixels, each with an intensity that is individually controlled. Manytypes of commercial displays, such as emissive LED and OLED displays,may be used in the LF display.

The energy device layer 220 may also include one or more acousticprojection devices and/or one or more acoustic receiving devices. Anacoustic projection device generates one or more pressure waves thatcomplement the holographic object 250. The generated pressure waves maybe, e.g., audible, ultrasonic, or some combination thereof. An array ofultrasonic pressure waves may be used for volumetric tactile sensation(e.g., coincident with a surface of the holographic object 250). Anaudible pressure wave is used for providing audio content (e.g.,immersive audio) that can complement the holographic object 250. Forexample, assuming the holographic object 250 is a dolphin, one or moreacoustic projection devices may be used to (1) generate a tactilesurface that is collocated with a surface of the dolphin such thatviewers may touch the holographic object 250; and (2) provide audiocontent corresponding to noises a dolphin makes such as clicks,chirping, or chatter. An acoustic receiving device (e.g., a microphoneor microphone array) may be configured to monitor ultrasonic and/oraudible pressure waves within a local area of the LF display module 210.

The energy device layer 220 may also include one or more imagingsensors. An imaging sensor may be sensitive to light in a visibleoptical band, and in some cases, may be sensitive to light in otherbands (e.g., infrared). The imaging sensor may be, e.g., a complementarymetal oxide semi-conductor (CMOS) array, a charged coupled device (CCD),an array of photodetectors, some other sensor that captures light, orsome combination thereof. The LF display system may use data captured bythe one or more imaging sensor for position location tracking ofviewers.

In some configurations, the energy relay layer 230 relays energy (e.g.,electromagnetic energy, mechanical pressure waves, etc.) between theenergy device layer 220 and the energy waveguide layer 240. The energyrelay layer 230 includes one or more energy relay elements 260. Eachenergy relay element includes a first surface 265 and a second surface270, and it relays energy between the two surfaces. The first surface265 of each energy relay element may be coupled to one or more energydevices (e.g., electronic display or acoustic projection device). Anenergy relay element may be composed of, e.g., glass, carbon, opticalfiber, optical film, plastic, polymer, or some combination thereof.Additionally, in some embodiments, an energy relay element may adjustmagnification (increase or decrease) of energy passing between the firstsurface 265 and the second surface 270. If the relay offersmagnification, then the relay may take the form of an array of bondedtapered relays, called tapers, where the area of one end of the tapermay be substantially larger than the opposite end. The large end of thetapers can be bonded together to form a seamless energy surface 275. Oneadvantage is that space is created on the multiple small ends of eachtaper to accommodate the mechanical envelope of multiple energy sources,such as the bezels of multiple displays. This extra room allows theenergy sources to be placed side-by-side on the small taper side, witheach energy source having their active areas directing energy into thesmall taper surface and relayed to the large seamless energy surface.Another advantage to using tapered relays is that there is nonon-imaging dead space on the combined seamless energy surface formed bythe large end of the tapers. No border or bezel exists, and so theseamless energy surfaces can then be tiled together to form a largersurface with virtually no seams according to the visual acuity of theeye.

The second surfaces of adjacent energy relay elements come together toform an energy surface 275. In some embodiments, a separation betweenedges of adjacent energy relay elements is less than a minimumperceptible contour as defined by a visual acuity of a human eye having,for example, 20/40 vision, such that the energy surface 275 iseffectively seamless from the perspective of a viewer 280 within aviewing volume 285.

In some embodiments, the second surfaces of adjacent energy relayelements are fused together with processing steps that may include oneor more of pressure, heat, and a chemical reaction, in such a way noseam exists between them. And still in other embodiments, an array ofenergy relay elements is formed by molding one side of a continuousblock of relay material into an array of small taper ends, eachconfigured to transport energy from an energy device attached to thesmall tapered end into a single combined surface with a larger areawhich is never subdivided.

In some embodiments, one or more of the energy relay elements exhibitenergy localization, where the energy transport efficiency in thelongitudinal direction substantially normal to the surfaces 265 and 270is much higher than the transport efficiency in the perpendiculartransverse plane, and where the energy density is highly localized inthis transverse plane as the energy wave propagates between surface 265and surface 270. This localization of energy allows an energydistribution, such as an image, to be efficiency relayed between thesesurfaces without any significant loss in resolution.

The energy waveguide layer 240 directs energy from a location (e.g., acoordinate) on the energy surface 275 into a specific energy propagationpath outward from the display surface into the holographic viewingvolume 285 using waveguide elements in the energy waveguide layer 240.The energy propagation path is defined by two angular dimensionsdetermined at least by the energy surface coordinate location relativeto the waveguide. The waveguide is associated with a spatial 2Dcoordinate. Together, these four coordinates form a four-dimensional(4D) energy field. As an example, for electromagnetic energy, thewaveguide elements in the energy waveguide layer 240 direct light frompositions on the seamless energy surface 275 along different propagationdirections through the viewing volume 285. In various examples, thelight is directed in accordance with a 4D light field function to formthe holographic object 250 within the holographic object volume 255.

Each waveguide element in the energy waveguide layer 240 may be, forexample, a lenslet composed of one or more elements. In someconfigurations, the lenslet may be a positive lens. The positive lensmay have a surface profile that is spherical, aspherical, or freeform.Additionally, in some embodiments, some or all of the waveguide elementsmay include one or more additional optical components. An additionaloptical component may be, e.g., an energy-inhibiting structure such as abaffle, a positive lens, a negative lens, a spherical lens, anaspherical lens, a freeform lens, a liquid crystal lens, a liquid lens,a refractive element, a diffractive element, or some combinationthereof. In some embodiments, the lenslet and/or at least one of theadditional optical components is able to dynamically adjust its opticalpower. For example, the lenslet may be a liquid crystal lens or a liquidlens. Dynamic adjustment of a surface profile the lenslet and/or atleast one additional optical component may provide additionaldirectional control of light projected from a waveguide element.

In the illustrated example, the holographic object volume 255 of the LFdisplay has boundaries formed by light ray 256 and light ray 257, butcould be formed by other rays. The holographic object volume 255 is acontinuous volume that extends both in front (i.e., towards the viewer280) of the energy waveguide layer 240 and behind it (i.e., away fromthe viewer 280). In the illustrated example, ray 256 and ray 257 areprojected from opposite edges of the LF display module 210 at thehighest angle relative to the normal to the display surface 277 that maybe perceived by a user, but these could be other projected rays. Therays define the field-of-view of the display, and, thus, define theboundaries for the holographic viewing volume 285. In some cases, therays define a holographic viewing volume where the full display can beobserved without vignetting (e.g., an ideal viewing volume). As thefield of view of the display increases, the convergence point of ray 256and ray 257 will be closer to the display. Thus, a display having alarger field of view allows a viewer 280 to see the full display at acloser viewing distance. Additionally, ray 256 and 257 may form an idealholographic object volume. Holographic objects presented in an idealholographic object volume can be seen anywhere in the viewing volume285.

In some examples, holographic objects may be presented to only a portionof the viewing volume 285. In other words, holographic object volumesmay be divided into any number of viewing sub-volumes (e.g., viewingsub-volume 290). Additionally, holographic objects can be projectedoutside of the holographic object volume 255. For example, holographicobject 251 is presented outside of holographic object volume 255.Because the holographic object 251 is presented outside of theholographic object volume 255 it cannot be viewed from every location inthe viewing volume 285. For example, holographic object 251 may bevisible from a location in viewing sub-volume 290, but not visible fromthe location of the viewer 280.

For example, we turn to FIG. 2B to illustrate viewing holographiccontent from different viewing sub-volumes. FIG. 2B illustrates a crosssection 200 of a portion of a LF display module, in accordance with oneor more embodiments. The cross-section of FIG. 2B is the same as thecross-section of FIG. 2A. However, FIG. 2B illustrates a different setof light rays projected from the LF display module 210. Ray 256 and ray257 still form a holographic object volume 255 and a viewing volume 285.However, as shown, rays projected from the top of the LF display module210 and the bottom of the LF display module 210 overlap to form variousviewing sub-volumes (e.g., view sub-volumes 290A, 290B, 290C, and 290D)within the viewing volume 285. A viewer in the first viewing sub-volume(e.g., 290A) may be able to perceive holographic content presented inthe holographic object volume 255 that viewers in the other viewingsub-volumes (e.g., 290B, 290C, and 290D) are unable to perceive.

More simply, as illustrated in FIG. 2A, holographic object volume 255 isa volume in which holographic objects may be presented by LF displaysystem such that they may be perceived by viewers (e.g., viewer 280) inviewing volume 285. In this way, the viewing volume 285 is an example ofan ideal viewing volume, while the holographic object volume 255 is anexample of an ideal object volume. However, in various configurations,viewers may perceive holographic objects presented by LF display system200 in other example holographic object volumes. More generally, an“eye-line guideline” applies when viewing holographic content projectedfrom an LF display module. The eye-line guideline asserts that the lineformed by a viewer's eye position and a holographic object being viewedmust intersect a LF display surface.

When viewing holographic content presented by the LF display module 210,each eye of the viewer 280 sees a different perspective of theholographic object 250 because the holographic content is presentedaccording to a 4D light field function. Moreover, as the viewer 280moves within the viewing volume 285 he/she would also see differentperspectives of the holographic object 250 as would other viewers withinthe viewing volume 285. As will be appreciated by one of ordinary skillin the art, a 4D light field function is well known in the art and willnot be elaborated further herein.

As described in more detail herein, in some embodiments, the LF displaycan project more than one type of energy. For example, the LF displaymay project two types of energy, such as, for example, mechanical energyand electromagnetic energy. In this configuration, energy relay layer230 may include two separate energy relays which are interleavedtogether at the energy surface 275, but are separated such that theenergy is relayed to two different energy device layers 220. Here, onerelay may be configured to transport electromagnetic energy, whileanother relay may be configured to transport mechanical energy. In someembodiments, the mechanical energy may be projected from locationsbetween the electromagnetic waveguide elements on the energy waveguidelayer 240, helping form structures that inhibit light from beingtransported from one electromagnetic waveguide element to another. Insome embodiments, the energy waveguide layer 240 may also includewaveguide elements that transport focused ultrasound along specificpropagation paths in accordance with display instructions from acontroller.

Note that in alternate embodiments (not shown), the LF display module210 does not include the energy relay layer 230. In this case, theenergy surface 275 is an emission surface formed using one or moreadjacent electronic displays within the energy device layer 220. And insome embodiments, with no energy relay layer, a separation between edgesof adjacent electronic displays is less than a minimum perceptiblecontour as defined by a visual acuity of a human eye having 20/40vision, such that the energy surface is effectively seamless from theperspective of the viewer 280 within the viewing volume 285.

LF Display Modules

FIG. 3A is a perspective view of a LF display module 300A, in accordancewith one or more embodiments. The LF display module 300A may be the LFdisplay module 110 and/or the LF display module 210. In otherembodiments, the LF display module 300A may be some other LF displaymodule. In the illustrated embodiment, the LF display module 300Aincludes an energy device layer 310, and energy relay layer 320, and anenergy waveguide layer 330. The LF display module 300A is configured topresent holographic content from a display surface 365 as describedherein. For convenience, the display surface 365 is illustrated as adashed outline on the frame 390 of the LF display module 300A, but is,more accurately, the surface directly in front of waveguide elementsbounded by the inner rim of the frame 390. The display surface 365includes a plurality of projection locations from which energy can beprojected. Some embodiments of the LF display module 300A have differentcomponents than those described here. For example, in some embodiments,the LF display module 300A does not include the energy relay layer 320.Similarly, the functions can be distributed among the components in adifferent manner than is described here.

The energy device layer 310 is an embodiment of the energy device layer220. The energy device layer 310 includes four energy devices 340 (threeare visible in the figure). The energy devices 340 may all be the sametype (e.g., all electronic displays), or may include one or moredifferent types (e.g., includes electronic displays and at least oneacoustic energy device).

The energy relay layer 320 is an embodiment of the energy relay layer230. The energy relay layer 320 includes four energy relay devices 350(three are visible in the figure). The energy relay devices 350 may allrelay the same type of energy (e.g., light), or may relay one or moredifferent types (e.g., light and sound). Each of the relay devices 350includes a first surface and a second surface, the second surface of theenergy relay devices 350 being arranged to form a singular seamlessenergy surface 360. In the illustrated embodiment, each of the energyrelay devices 350 are tapered such that the first surface has a smallersurface area than the second surface, which allows accommodation for themechanical envelopes of the energy devices 340 on the small end of thetapers. This also allows the seamless energy surface to be borderless,since the entire area can project energy. This means that this seamlessenergy surface can be tiled by placing multiple instances of LF displaymodule 300A together, without dead space or bezels, so that the entirecombined surface is seamless. In other embodiments, the first surfaceand the second surface have the same surface area.

The energy waveguide layer 330 is an embodiment of the energy waveguidelayer 240. The energy waveguide layer 330 includes a plurality ofwaveguide elements 370. As discussed above with respect to FIG. 2, theenergy waveguide layer 330 is configured to direct energy from theseamless energy surface 360 along specific propagation paths inaccordance with a 4D light field function to form a holographic object.Note that in the illustrated embodiment the energy waveguide layer 330is bounded by a frame 390. In other embodiments, there is no frame 390and/or a thickness of the frame 390 is reduced. Removal or reduction ofthickness of the frame 390 can facilitate tiling the LF display module300A with additional LF display modules.

Note that in the illustrated embodiment, the seamless energy surface 360and the energy waveguide layer 330 are planar. In alternate embodiments,not shown, the seamless energy surface 360 and the energy waveguidelayer 330 may be curved in one or more dimensions.

The LF display module 300A can be configured with additional energysources that reside on the surface of the seamless energy surface, andallow the projection of an energy field in additional to the lightfield. In one embodiment, an acoustic energy field may be projected fromelectrostatic speakers (not illustrated) mounted at any number oflocations on the seamless energy surface 360. Further, the electrostaticspeakers of the LF display module 300A are positioned within the lightfield display module 300A such that the dual-energy surfacesimultaneously projects sound fields and holographic content. Forexample, the electrostatic speakers may be formed with one or morediaphragm elements that are transmissive to some wavelengths ofelectromagnetic energy, and driven with one or more conductive elements(e.g., planes which sandwich the one or more diaphragm elements). Theelectrostatic speakers may be mounted on to the seamless energy surface360, so that the diaphragm elements cover some of the waveguideelements. The conductive electrodes of the speakers may be co-locatedwith structures designed to inhibit light transmission betweenelectromagnetic waveguides, and/or located at positions betweenelectromagnetic waveguide elements (e.g., frame 390). In variousconfigurations, the speakers can project an audible sound and/or manysources of focused ultrasonic energy that produces a haptic surface.

In some configurations an energy device 340 may sense energy. Forexample, an energy device may be a microphone, a light sensor, anacoustic transducer, etc. As such, the energy relay devices may alsorelay energy from the seamless energy surface 360 to the energy devicelayer 310. That is, the seamless energy surface 360 of the LF displaymodule forms a bidirectional energy surface when the energy devices andenergy relay devices 340 are configured to simultaneously emit and senseenergy (e.g., emit sound fields and sense sound, emit light fields andsense light).

More broadly, an energy device 340 of a LF display module 340 can beeither an energy source or an energy sensor. The LF display module 300Acan include various types of energy devices that act as energy sourcesand/or energy sensors to facilitate the projection of high qualityholographic content to a user. Other sources and/or sensors may includethermal sensors or sources, infrared sensors or sources, image sensorsor sources, mechanical energy transducers that generate acoustic energy,feedback sources, etc. Many other sensors or sources are possible.Further, the LF display modules can be tiled such that the LF displaymodule can form an assembly that projects and senses multiple types ofenergy from a large aggregate seamless energy surface

In various embodiments of LF display module 300A, the seamless energysurface 360 can have various surface portions where each surface portionis configured to project and/or emit specific types of energy. Forexample, when the seamless energy surface is a dual-energy surface, theseamless energy surface 360 includes one or more surface portions thatproject electromagnetic energy, and one or more other surface portionsthat project ultrasonic energy. The surface portions that projectultrasonic energy may be located on the seamless energy surface 360between electromagnetic waveguide elements, and/or co-located withstructures designed to inhibit light transmission betweenelectromagnetic waveguide elements. In an example where the seamlessenergy surface is a bidirectional energy surface, the energy relay layer320 may include two types of energy relay devices interleaved at theseamless energy surface 360. In various embodiments, the seamless energysurface 360 may be configured such that portions of the surface underany particular waveguide element 370 are all energy sources, all energysensors, or a mix of energy sources and energy sensors.

FIG. 3B is a cross-sectional view of a LF display module 300B whichincludes interleaved energy relay devices, in accordance with one ormore embodiments. Energy relay device 350A transports energy between theenergy relay first surface 345A connected to energy device 340A, and theseamless energy surface 360. Energy relay 350B transports energy betweenthe energy relay first surface 345B connected to energy device 340B, andthe seamless energy surface 360. Both relay devices are interleaved atinterleaved energy relay device 352, which is connected to the seamlessenergy surface 360. In this configuration, surface 360 containsinterleaved energy locations of both energy devices 340A and 340B, whichmay be energy sources or energy sensors. Accordingly, the LF displaymodule 300B may be configured as either a dual energy projection devicefor projecting more than one type of energy, or as a bidirectionalenergy device for simultaneously projecting one type of energy andsensing another type of energy. The LF display module 300B may be the LFdisplay module 110 and/or the LF display module 210. In otherembodiments, the LF display module 300B may be some other LF displaymodule.

The LF display module 300B includes many components similarly configuredto those of LF display module 300A in FIG. 3A. For example, in theillustrated embodiment, the LF display module 300B includes an energydevice layer 310, energy relay layer 320, a seamless energy surface 360,and an energy waveguide layer 330 including at least the samefunctionality of those described in regard to FIG. 3A. Additionally, theLF display module 300B may present and/or receive energy from thedisplay surface 365. Notably, the components of the LF display module300B are alternatively connected and/or oriented than those of the LFdisplay module 300A in FIG. 3A. Some embodiments of the LF displaymodule 300B have different components than those described here.Similarly, the functions can be distributed among the components in adifferent manner than is described here. FIG. 3B illustrates the designof a single LF display module 300B that may be tiled to produce a dualenergy projection surface or a bidirectional energy surface with alarger area.

In an embodiment, the LF display module 300B is a LF display module of abidirectional LF display system. A bidirectional LF display system maysimultaneously project energy and sense energy from the display surface365. The seamless energy surface 360 contains both energy projecting andenergy sensing locations that are closely interleaved on the seamlessenergy surface 360. Therefore, in the example of FIG. 3B, the energyrelay layer 320 is configured in a different manner than the energyrelay layer of FIG. 3A. For convenience, the energy relay layer of LFdisplay module 300B will be referred to herein as the “interleavedenergy relay layer.”

The interleaved energy relay layer 320 includes two legs: a first energyrelay device 350A and a second energy relay device 350B. Each of thelegs are illustrated as a lightly shaded area in FIG. 3B. Each of thelegs may be made of a flexible relay material, and formed with asufficient length to use with energy devices of various sizes andshapes. In some regions of the interleaved energy relay layer, the twolegs are tightly interleaved together as they approach the seamlessenergy surface 360. In the illustrated example, the interleaved energyrelay devices 352 are illustrated as a darkly shaded area.

While interleaved at the seamless energy surface 360, the energy relaydevices are configured to relay energy to/from different energy devices.The energy devices are at energy device layer 310. As illustrated,energy device 340A is connected to energy relay device 350A and energydevice 340B is connected to energy relay device 350B. In variousembodiments, each energy device may be an energy source or energysensor.

An energy waveguide layer 330 includes waveguide elements 370 to steerenergy waves from the seamless energy surface 360 along projected pathstowards a series of convergence points. In this example, a holographicobject 380 is formed at the series of convergence points. Notably, asillustrated, the convergence of energy at the holographic object 380occurs on the viewer side (i.e., the front side), of the display surface365. However, in other examples, the convergence of energy may beanywhere in the holographic object volume, which extends both in frontof the display surface 365 and behind the display surface 365. Thewaveguide elements 370 can simultaneously steer incoming energy to anenergy device (e.g., an energy sensor), as described below.

In one example embodiment of LF display module 300B, an emissive displayis used as an energy source (e.g., energy device 340A) and an imagingsensor is used as an energy sensor (e.g., energy device 340B). In thismanner, the LF display module 300B can simultaneously projectholographic content and detect light from the volume in front of thedisplay surface 365. In this manner, this embodiment of the LF displaymodule 300B functions as both a LF display and an LF sensor.

In an embodiment, the LF display module 300B is configured tosimultaneously project a light field from projection locations on thedisplay surface to the front of the display surface and capture a lightfield from front of the display surface at the projection locations. Inthis embodiment, the energy relay device 350A connects a first set oflocations at the seamless energy surface 360 positioned under thewaveguide elements 370 to an energy device 340A. In an example, energydevice 340A is an emissive display having an array of source pixels. Theenergy relay device 340B connects a second set of locations at theseamless energy surface 360 positioned under waveguide elements 370 toan energy device 340B. In an example, the energy device 340B is animaging sensor having an array of sensor pixels. The LF display module300B may be configured such that the locations at the seamless energysurface 365 that are under a particular waveguide element 370 are allemissive display locations, all imaging sensor locations, or somecombination of these locations. In other embodiments, the bidirectionalenergy surface can project and receive various other forms of energy.

In another example embodiment of the LF display module 300B, the LFdisplay module is configured to project two different types of energy.For example, in an embodiment, energy device 340A is an emissive displayconfigured to emit electromagnetic energy and energy device 340B is anultrasonic transducer configured to emit mechanical energy. As such,both light and sound can be projected from various locations at theseamless energy surface 360. In this configuration, energy relay device350A connects the energy device 340A to the seamless energy surface 360and relays the electromagnetic energy. The energy relay device isconfigured to have properties (e.g. varying refractive index) which makeit efficient for transporting electromagnetic energy. Energy relaydevice 350B connects the energy device 340B to the seamless energysurface 360 and relays mechanical energy. Energy relay device 350B isconfigured to have properties for efficient transport of ultrasoundenergy (e.g. distribution of materials with different acousticimpedance). In some embodiments, the mechanical energy may be projectedfrom locations between the waveguide elements 370 on the energywaveguide layer 330. The locations that project mechanical energy mayform structures that serve to inhibit light from being transported fromone electromagnetic waveguide element to another. In one example, aspatially separated array of locations that project ultrasonicmechanical energy can be configured to create three-dimensional hapticshapes and surfaces in mid-air. The surfaces may coincide with projectedholographic objects (e.g., holographic object 380). In some examples,phase delays and amplitude variations across the array can assist increating the haptic shapes.

In various embodiments, the LF display module 300B with interleavedenergy relay devices may include multiple energy device layers with eachenergy device layer including a specific type of energy device. In theseexamples, the energy relay layers are configured to relay theappropriate type of energy between the seamless energy surface 360 andthe energy device layer 310.

Tiled LF Display Modules

FIG. 4A is a perspective view of a portion of LF display system 400 thatis tiled in two dimensions to form a single-sided seamless surfaceenvironment, in accordance with one or more embodiments. The LF displaysystem 400 includes a plurality of LF display modules that are tiled toform an array 410. More explicitly, each of the small squares in thearray 410 represents a tiled LF display module 412. The LF displaymodule 412 may be the same as LF display module 300A or 300B. The array410 may cover, for example, some or all of a surface (e.g., a wall) of aroom. The LF array may cover other surfaces, such as, for example, atable top, a billboard, a rotunda, etc.

The array 410 may project one or more holographic objects. For example,in the illustrated embodiment, the array 410 projects a holographicobject 420 and a holographic object 422. Tiling of the LF displaymodules 412 allows for a much larger viewing volume as well as allowsfor objects to be projected out farther distances from the array 410.For example, in the illustrated embodiment, the viewing volume is,approximately, the entire area in front of and behind the array 410rather than a localized volume in front of (and behind) a LF displaymodule 412.

In some embodiments, the LF display system 400 presents the holographicobject 420 to a viewer 430 and a viewer 434. The viewer 430 and theviewer 434 receive different perspectives of the holographic object 420.For example, the viewer 430 is presented with a direct view of theholographic object 420, whereas the viewer 434 is presented with a moreoblique view of the holographic object 420. As the viewer 430 and/or theviewer 434 move, they are presented with different perspectives of theholographic object 420. This allows a viewer to visually interact with aholographic object by moving relative to the holographic object. Forexample, as the viewer 430 walks around a holographic object 420, theviewer 430 sees different sides of the holographic object 420 as long asthe holographic object 420 remains in the holographic object volume ofthe array 410. Accordingly, the viewer 430 and the viewer 434 maysimultaneously see the holographic object 420 in real-world space as ifit is truly there. Additionally, the viewer 430 and the viewer 434 donot need to wear an external device in order to see the holographicobject 420, as the holographic object 420 is visible to viewers in muchthe same way a physical object would be visible. Additionally, here, theholographic object 422 is illustrated behind the array because theviewing volume of the array extends behind the surface of the array. Inthis manner, the holographic object 422 may be presented to the viewer430 and/or viewer 434.

In some embodiments, the LF display system 400 may include a trackingsystem that tracks positions of the viewer 430 and the viewer 434. Insome embodiments, the tracked position is the position of a viewer. Inother embodiments, the tracked position is that of the eyes of a viewer.The position tracking of the eye is different from gaze tracking whichtracks where an eye is looking (e.g., uses orientation to determine gazelocation). The eyes of the viewer 430 and the eyes of the viewer 434 arein different locations.

In various configurations, the LF display system 400 may include one ormore tracking systems. For example, in the illustrated embodiment ofFIG. 4A, LF display system includes a tracking system 440 that isexternal to the array 410. Here, the tracking system may be a camerasystem coupled to the array 410. External tracking systems are describedin more detail in regard to FIG. 5. In other example embodiments, thetracking system may be incorporated into the array 410 as describedherein. For example, an energy device (e.g., energy device 340) of oneor more LF display modules 412 containing a bidirectional energy surfaceincluded in the array 410 may be configured to capture images of viewersin front of the array 410. In whichever case, the tracking system(s) ofthe LF display system 400 determines tracking information about theviewers (e.g., viewer 430 and/or viewer 434) viewing holographic contentpresented by the array 410.

Tracking information describes a position in space (e.g., relative tothe tracking system) for the position of a viewer, or a position of aportion of a viewer (e.g. one or both eyes of a viewer, or theextremities of a viewer). A tracking system may use any number of depthdetermination techniques to determine tracking information. The depthdetermination techniques may include, e.g., structured light, time offlight, stereo imaging, some other depth determination technique, orsome combination thereof. The tracking system may include varioussystems configured to determine tracking information. For example, thetracking system may include one or more infrared sources (e.g.,structured light sources), one or more imaging sensors that can captureimages in the infrared (e.g., red-blue-green-infrared camera), and aprocessor executing tracking algorithms. The tracking system may use thedepth estimation techniques to determine positions of viewers. In someembodiments, the LF display system 400 generates holographic objectsbased on tracked positions, movements, or gestures of the viewer 430and/or the viewer 434 as described herein. For example, the LF displaysystem 400 may generate a holographic object responsive to a viewercoming within a threshold distance of the array 410 and/or a particularposition.

The LF display system 400 may present one or more holographic objectsthat are customized to each viewer based in part on the trackinginformation. For example, the viewer 430 may be presented with theholographic object 420, but not the holographic object 422. Similarly,the viewer 434 may be presented with the holographic object 422, but notthe holographic object 420. For example, the LF display system 400tracks a position of each of the viewer 430 and the viewer 434. The LFdisplay system 400 determines a perspective of a holographic object thatshould be visible to a viewer based on their position relative to wherethe holographic object is to be presented. The LF display system 400selectively projects light from specific pixels that correspond to thedetermined perspective. Accordingly, the viewer 434 and the viewer 430can simultaneously have experiences that are, potentially, completelydifferent. In other words, the LF display system 400 may presentholographic content to viewing sub-volumes of the viewing volume (i.e.,similar to the viewing sub-volumes 290A, 290B, 290C, and 290D shown inFIG. 2B). For example, as illustrated, because the LF display system 400can track the position of the viewer 430, the LF display system 400 maypresent space content (e.g., holographic object 420) to a viewingsub-volume surrounding the viewer 430 and safari content (e.g.,holographic object 422) to a viewing sub-volume surrounding the viewer434. In contrast, conventional systems would have to use individualheadsets to provide a similar experience.

In some embodiments the LF display system 400 may include one or moresensory feedback systems. The sensory feedback systems provide othersensory stimuli (e.g., tactile, audio, or smell) that are presented withthe holographic content and augment the holographic objects 420 and 422.For example, in the illustrated embodiment of FIG. 4A, the LF displaysystem 400 includes a sensory feedback system 442 external to the array410. In one example, the sensory feedback system 442 may be anelectrostatic speaker coupled to the array 410. External sensoryfeedback systems are described in more detail in regard to FIG. 5. Inother example embodiments, the sensory feedback system may beincorporated into the array 410 as described herein. For example, anenergy device (e.g., energy device 340A in FIG. 3B) of a LF displaymodule 412 included in the array 410 may be configured to projectultrasonic energy to viewers in front of the array and/or receiveimaging information from viewers in front of the array. In whichevercase, the sensory feedback system presents and/or receives sensorycontent to/from the viewers (e.g., viewer 430 and/or viewer 434) viewingholographic content (e.g., holographic object 420 and/or holographicobjected 422) presented by the array 410.

The LF display system 400 may include a sensory feedback system 442 thatincludes one or more acoustic projection devices external to the array.Alternatively or additionally, the LF display system 400 may include oneor more acoustic projection devices integrated into the array 410 asdescribed herein. The acoustic projection devices may consist of anarray of ultrasonic sources configured to project a volumetric tactilesurface. In some embodiments, the tactile surface may be coincident witha holographic object (e.g., at a surface of the holographic object 420)for one or more surfaces of a holographic object if a portion of aviewer gets within a threshold distance of the one or more surfaces. Thevolumetric tactile sensation may allow the user to touch and feelsurfaces of the holographic object. The plurality of acoustic projectiondevices may also project an audible pressure wave that provides audiocontent (e.g., immersive audio) to viewers. Accordingly, the ultrasonicpressure waves and/or the audible pressure waves can act to complement aholographic object.

In various embodiments, the LF display system 400 may provide othersensory stimuli based in part on a tracked position of a viewer. Forexample, the holographic object 422 illustrated in FIG. 4A is a lion,and the LF display system 400 may have the holographic object 422 roarboth visually (i.e., the holographic object 422 appears to roar) andaudibly (i.e., one or more acoustic projection devices project apressure wave that the viewer 430 perceives as a lion's roar emanatingfrom the holographic object 422.

Note that, in the illustrated configuration, the holographic viewingvolume may be limited in a manner similar to the viewing volume 285 ofthe LF display system 200 in FIG. 2A-2B. This can limit the amount ofperceived immersion that a viewer will experience with a single walldisplay unit. One way to address this is to use multiple LF displaymodules that are tiled along multiple sides as described below withrespect to FIGS. 4B-4F, 6B, and 8A-8B.

FIG. 4B is a perspective view of a portion of a LF display system 402 ina multi-sided seamless surface environment, in accordance with one ormore embodiments. The LF display system 402 is substantially similar tothe LF display system 400 except that the plurality of LF displaymodules are tiled to create a multi-sided seamless surface environment.More specifically, the LF display modules are tiled to form an arraythat is a six-sided aggregated seamless surface environment. In FIG. 4B,the plurality of LF display modules cover all the walls, the ceiling,and the floor of a room. In other embodiments, the plurality of LFdisplay modules may cover some, but not all of a wall, a floor, aceiling, or some combination thereof. In other embodiments, a pluralityof LF display modules are tiled to form some other aggregated seamlesssurface. For example, the walls may be curved such that a cylindricalaggregated energy environment is formed.

Alternatively, the walls and ceiling may be curved to form a sphericalaggregated energy surface environment.

The LF display system 402 may project one or more holographic objects.For example, in the illustrated embodiment the LF display system 402projects the holographic object 420 into an area enclosed by thesix-sided aggregated seamless surface environment. In this example, theviewing volume of the LF display system is also contained within thesix-sided aggregated seamless surface environment. Note that, in theillustrated configuration, the viewer 434 may be positioned between theholographic object 420 and a LF display module 414 that is projectingenergy (e.g., light and/or pressure waves) that is used to form theholographic object 420. Accordingly, the positioning of the viewer 434may prevent the viewer 430 from perceiving the holographic object 420formed from energy from the LF display module 414. However, in theillustrated configuration there is at least one other LF display module,e.g., a LF display module 416, that is unobstructed (e.g., by the viewer434) and can project energy to form the holographic object 420 and beobserved by viewer 430. In this manner, occlusion by viewers in thespace can cause some portion of the holographic projections todisappear, but the effect is much less than if only one side of thevolume was populated with holographic display panels. Holographic object422 is illustrated “outside” the walls of the six-sided aggregatedseamless surface environment because the holographic object volumeextends behind the aggregated surface. Thus, the viewer 430 and/or theviewer 434 can perceive the holographic object 422 as “outside” of theenclosed six-sided environment which they can move throughout.

As described above in reference to FIG. 4A, in some embodiments, the LFdisplay system 402 actively tracks positions of viewers and maydynamically instruct different LF display modules to present holographiccontent based on the tracked positions. Accordingly, a multi-sidedconfiguration can provide a more robust environment (e.g., relative toFIG. 4A) for providing holographic objects where unconstrained viewersare free to move throughout the area enclosed by the multi-sidedseamless surface environment.

Notably, various LF display systems may have different configurations.Further, each configuration may have a particular orientation ofsurfaces that, in aggregate, form a seamless display surface (“aggregatesurface”). That is, the LF display modules of a LF display system can betiled to form a variety of aggregate surfaces. For example, in FIG. 4B,the LF display system 402 includes LF display modules tiled to form asix-sided aggregate surface that approximates the walls of a room. Insome other examples, an aggregate surface may only occur on a portion ofa surface (e.g., half of a wall) rather than a whole surface (e.g., anentire wall). Some examples are described herein.

In some configurations, the aggregate surface of a LF display system mayinclude an aggregate surface configured to project energy towards alocalized viewing volume. Projecting energy to a localized viewingvolume allows for a higher quality viewing experience by, for example,increasing the density of projected energy in a specific viewing volume,increasing the FOV for the viewers in that volume, and bringing theviewing volume closer to the display surface.

For example, FIG. 4C illustrates top down view of a LF display system450A with an aggregate surface in a “winged” configuration. In thisexample, the LF display system 450A is located in a room with a frontwall 452, a rear wall 454, a first sidewall 456, a second sidewall 458,a ceiling (not shown), and a floor (not shown). The first sidewall 456,the second sidewall 458, the rear wall 454, floor, and the ceiling areall orthogonal. The LF display system 450A includes LF display modulestiled to form an aggregate surface 460 covering the front wall. Thefront wall 452, and thus the aggregate surface 460, includes threeportions: (i) a first portion 462 approximately parallel with the rearwall 454 (i.e., a central surface), (ii) a second portion 464 connectingthe first portion 462 to the first sidewall 456 and placed at an angleto project energy towards the center of the room (i.e., a first sidesurface), and (iii) a third portion 466 connecting the first portion 462to the second sidewall 458 and placed at an angle to project energytowards the center of the room (i.e., a second side surface). The firstportion is a vertical plane in the room and has a horizontal and avertical axis. The second and third portions are angled towards thecenter of the room along the horizontal axis.

In this example, the viewing volume 468A of the LF display system 450Ais in the center of the room and partially surrounded by the threeportions of the aggregate surface 460. An aggregate surface that atleast partially surrounds a viewer (“surrounding surface”) increases theimmersive experience of the viewers.

To illustrate, consider, for example, an aggregate surface with only acentral surface. Referring to FIG. 2A, the rays that are projected fromeither end of the display surface create an ideal holographic volume andideal viewing volumes as described above. Now consider, for example, ifthe central surface included two side surfaces angled towards theviewer. In this case, ray 256 and ray 257 would be projected at agreater angle from a normal of the central surface. Thus, the field ofview of the viewing volume would increase. Similarly, the holographicviewing volume would be nearer the display surface. Additionally,because the two second and third portions tilted nearer the viewingvolume, the holographic objects that are projected at a fixed distancefrom the display surface are closer to that viewing volume.

To simplify, a display surface with only a central surface has a planarfield of view, a planar threshold separation between the (central)display surface and the viewing volume, and a planar proximity between aholographic object and the viewing volume. Adding one or more sidesurfaces angled towards the viewer increases the field of view relativeto the planar field of view, decreases the separation between thedisplay surface and the viewing volume relative to the planarseparation, and increases the proximity between the display surface anda holographic object relative to the planar proximity. Further anglingthe side surfaces towards the viewer further increases the field ofview, decreases the separation, and increases the proximity. In otherwords, the angled placement of the side surfaces increases the immersiveexperience for viewers.

In a similar example, FIG. 4D illustrates a side view of a LF displaysystem 450B with an aggregate surface in a “sloped” configuration. Inthis example, the LF display system 450B is located in a room with afront wall 452, a rear wall 454, a first sidewall (not shown), a secondsidewall (not shown), a ceiling 472, and a floor 474. The firstsidewall, the second sidewall, the rear wall 454, floor 474, and theceiling 472 are all orthogonal. The LF display system 450B includes LFdisplay modules tiled to form an aggregate surface 460 covering thefront wall. The front wall 452, and thus the aggregate surface 460,includes three portions: (i) a first portion 462 approximately parallelwith the rear wall 454 (i.e., a central surface), (ii) a second portion464 connecting the first portion 462 to the ceiling 472 and angled toproject energy towards the center of the room (i.e., a first sidesurface), and (iii) a third portion 464 connecting the first portion 462to the floor 474 and angled to project energy towards the center of theroom (i.e., a second side surface). The first portion is a verticalplane in the room and has a horizontal and a vertical axis. The secondand third portions are angled towards the center of the room along thevertical axis.

In this example, the viewing volume 468B of the LF display system 450Bis in the center of the room and partially surrounded by the threeportions of the aggregate surface 460. Similar to the configurationshown in FIG. 4C, the two side portions (e.g., second portion 464, andthird portion 466) are angled to surround the viewer and form asurrounding surface. The surrounding surface increases the viewing FOVfrom the perspective of any viewer in the holographic viewing volume468B. Additionally, the surrounding surface allows the viewing volume468B to be closer to the surface of the displays such that projectedobjects appear closer. In other words, the angled placement of the sidesurfaces increases the field of view, decreases the separation, andincreases the proximity of the aggregate surface, thereby increasing theimmersive experience for viewers. Further, deflection optics may be usedto optimize the size and position of the viewing volume 468B.

The sloped configuration of the side portions of the aggregate surface460 enables holographic content to be presented closer to the viewingvolume 468B than if the third portion 466 was not sloped. For example,the lower extremities (e.g., legs) of a character presented form a LFdisplay system in a sloped configuration may seem closer and morerealistic than if a LF display system with a flat front wall were used.

Additionally, the configuration of the LF display system and theenvironment which it is located may inform the shape and locations ofthe viewing volumes and viewing sub-volumes.

FIG. 4E, for example, illustrates a top down view of a LF display system450C with an aggregate surface 460 on a front wall 452 of a room. Inthis example, the LF display system 450D is located in a room with afront wall 452, a rear wall 454, a first sidewall 456, a second sidewall458, a ceiling (not shown), and a floor (not shown).

LF display system 450C projects various rays from the aggregate surface460. From each position on the display surface, light rays are projectedin an angular range that is centered on the viewing volume. The raysprojected from the left side of the aggregate surface 460 havehorizontal angular range 481, rays projected from the right side of theaggregate surface have horizontal angular range 482, and rays projectedfrom the center of the aggregate surface 460 have horizontal angularrange 483. Having a gradient deflection angle in the projected raysacross the display surface in this manner creates a viewing volume 468C.Further, this configuration avoids wasting resolution of the display onprojecting rays into the side walls 456 and 458.

FIG. 4F illustrates a side view of a LF display system 450D with anaggregate surface 460 on a front wall 452 of a room. In this example,the LF display system 450E is located in a room with a front wall 452, arear wall 454, a first sidewall (not shown), a second sidewall (notshown), a ceiling 472, and a floor 474. In this example, the floor istiered such that each tier rises in steps moving from the front wall tothe back wall. Here, each tier of the floor includes a viewingsub-volume (e.g., viewing sub volume 470A and 470B). A tiered floorallows for viewing sub-volumes that do not overlap. That is, eachviewing sub-volume has a line of sight from the viewing sub-volume tothe aggregate surface 460 that does not pass through another viewingsub-volume. In other words, this orientation produces a “stadiumseating” effect in which the vertical offset between tiers allows anunobstructed line of sight which allows each tier to “see over” theviewing sub-volumes of other tiers. LF display systems including viewingsub-volumes that do not overlap may provide a higher quality viewingexperience than LF display systems that have viewing volumes that dooverlap. For example, in the configuration shown in FIG. 4F, differentholographic content may be projected to the audiences in viewingsub-volumes 470A and 470B.

Control of a LF Display System

FIG. 5 is a block diagram of a LF display system 500, in accordance withone or more embodiments. The LF display system 500 comprises a LFdisplay assembly 510 and a controller 520. The LF display assembly 510includes one or more LF display modules 512 which project a light field.A LF display module 512 may include a source/sensor system 514 thatincludes an integrated energy source(s) and/or energy sensor(s) whichproject and/or sense other types of energy. The controller 520 includesa datastore 522, a network interface 524, and a LF processing engine530. The controller 520 may also include a tracking module 526, and aviewer profiling module 528. In some embodiments, the LF display system500 also includes a sensory feedback system 570 and a tracking system580. The LF display systems described in the context of FIGS. 1, 2A, 2B,3A, 3B, and 4A-F discuss embodiments of the LF display system 500. Inother embodiments, the LF display system 500 comprises additional orfewer modules than those described herein. Similarly, the functions canbe distributed among the modules and/or different entities in adifferent manner than is described here. Applications of the LF displaysystem 500 are also discussed in detail below with regard to FIGS.6A-8B.

The LF display assembly 510 provides holographic content in aholographic object volume that may be visible to viewers located withina viewing volume. The LF display assembly 510 may provide holographiccontent by executing display instructions received from the controller520. The holographic content may include one or more holographic objectsthat are projected in front of an aggregate surface the LF displayassembly 510, behind the aggregate surface of the LF display assembly510, or some combination thereof. Generating display instructions withthe controller 520 is described in more detail below.

The LF display assembly 510 provides holographic content using one ormore LF display modules (e.g., any of the LF display module 110, the LFdisplay system 200, and LF display module 300) included in an LF displayassembly 510. For convenience, the one or more LF display modules may bedescribed herein as LF display module 512. The LF display module 512 canbe tiled to form a LF display assembly 510. The LF display modules 512may be structured as various seamless surface environments (e.g., singlesided, multi-sided, a wall of an enclosure, a curved surface, etc.).That is, the tiled LF display modules form an aggregate surface. Aspreviously described, a LF display module 512 includes an energy devicelayer (e.g., energy device layer 220) and an energy waveguide layer(e.g., energy waveguide layer 240) that present holographic content. TheLF display module 512 may also include an energy relay layer (e.g.,energy relay layer 230) that transfers energy between the energy devicelayer and the energy waveguide layer when presenting holographiccontent.

The LF display module 512 may also include other integrated systemsconfigured for energy projection and/or energy sensing as previouslydescribed. For example, a light field display module 512 may include anynumber of energy devices (e.g., energy device 340) configured to projectand/or sense energy. For convenience, the integrated energy projectionsystems and integrated energy sensing systems of the LF display module512 may be described herein, in aggregate, as the source/sensor system514. The source/sensor system 514 is integrated within the LF displaymodule 512, such that the source/sensor system 514 shares the sameseamless energy surface with LF display module 512. In other words, theaggregate surface of an LF display assembly 510 includes thefunctionality of both the LF display module 512 and the source/sensormodule 514. That is, an LF assembly 510 including a LF display module512 with a source/sensor system 514 may project energy and/or senseenergy while simultaneously projecting a light field. For example, theLF display assembly 510 may include a LF display module 512 andsource/sensor system 514 configured as a dual-energy surface orbidirectional energy surface as previously described.

In some embodiments, the LF display system 500 augments the generatedholographic content with other sensory content (e.g., coordinated touch,audio, smell, temperature, etc.) using a sensory feedback system 570.The sensory feedback system 570 may augment the projection ofholographic content by executing display instructions received from thecontroller 520. Generally, the sensory feedback system 570 includes anynumber of sensory feedback devices external to the LF display assembly510 (e.g., sensory feedback system 442). Some example sensory feedbackdevices may include coordinated acoustic projecting and receivingdevices, aroma projecting devices, temperature adjustment devices, forceactuation devices, pressure sensors, transducers, some other sensoryfeedback devices, or some combination thereof. The sensory feedbackincludes tactile feedback (e.g., a touch), audio feedback (e.g., asound), aroma feedback (e.g., a smell), temperature feedback (e.g., anexposure to cold or heat), some other type of sensory feedback, or anycombination thereof. In some cases, the sensory feedback system 570 mayhave similar functionality to the light field display assembly 510 andvice versa. For example, both a sensory feedback system 570 and a lightfield display assembly 510 may be configured to generate a sound field.As another example, the sensory feedback system 570 may be configured togenerate haptic surfaces while the light field display 510 assembly isnot. The sensory feedback system 570 can be used in any LF displaysystem in an amusement park (e.g., in an enclosure, in a user station,in a queue, etc.).

To illustrate, in an example embodiment of a light field display system500, a sensory feedback system 570 may include one or more acousticprojection devices. The one or more acoustic projection devices areconfigured to generate one or more pressure waves that complement theholographic content when executing display instructions received fromthe controller 520. The generated pressure waves may be, e.g., audible(for sound), ultrasonic (for touch), or some combination thereof.Similarly, the sensory feedback system 570 may include an aromaprojecting device. The aroma projecting device may be configured toprovide scents to some, or all, of the viewing volume (e.g., theenclosure of the amusement park ride, the queue at an amusement park,etc.) when executing display instructions received from the controller.The aroma devices may be tied into an air circulation system (e.g.,ducting, fans, or vents) to coordinate air flow within the viewingvolume. Further, the sensory feedback system 570 may include atemperature adjustment device. The temperature adjustment device isconfigured to increase or decrease temperature in some, or all, of theviewing volume when executing display instructions received from thecontroller 520.

In some embodiments, the sensory feedback system 570 is configured toreceive input from viewers of the LF display system 500. In this case,the sensory feedback system 570 includes various sensory feedbackdevices for receiving input from viewers. The sensor feedback devicesmay include devices such as acoustic receiving devices (e.g., amicrophone), pressure sensors, joysticks, motion detectors, transducers,etc. The sensory feedback system may transmit the detected input to thecontroller 520 to coordinate generating holographic content and/orsensory feedback.

To illustrate, in an example embodiment of a light field displayassembly, a sensory feedback system 570 includes a microphone. Themicrophone is configured to record audio produced by one or more viewers(e.g., gasps, screams, laughter, etc.). The sensory feedback system 570provides the recorded audio to the controller 520 as viewer input. Thecontroller 520 may use the viewer input to generate holographic content.Similarly, the sensory feedback system 570 may include a pressuresensor. The pressure sensor is configured to measure forces applied byviewers to the pressure sensor. The sensory feedback system 570 mayprovide the measured forces to the controller 520 as viewer input.

In some embodiments, the LF display system 500 includes a trackingsystem 580. The tracking system 580 includes any number of trackingdevices configured to obtain information of the one or more viewers inthe viewing volume. The tracking module may obtain information aboutviewers including a position of the viewer (e.g., a viewer's locationbased on a reference point), a movement of the viewer (e.g., viewerwalked from the left to the right), a gesture of the viewer (e.g.,viewer raised their arms up over their head), a gaze of a viewer (e.g.,a viewer looking at a holographic character's face), an expression ofthe viewer (e.g., viewer smiled), an age of the viewer (e.g., viewer isan adult), a gender of the viewer (e.g., viewer is female), anidentification of some or all of a piece of a garment worn by the viewer(e.g., viewer is wearing a shirt with kittens on it), or an auditoryfeedback of the viewer (e.g., a command or a laugh of the viewer). Thecontroller 520 (e.g., the LF processing engine 530) generatesholographic content based on the obtained information gathered by thetracking system 580. Generally, the tracking devices are external to theLF display assembly 510. Some example tracking devices include a cameraassembly (“camera”), a depth sensor, structured light, a LIDAR system, acard scanning system, or any other tracking device that can trackviewers within a target area. The tracking system 580 can be used in anyLF display system in an amusement park (e.g., in an enclosure, in a userstation, in a queue, etc.).

The tracking system 580 may include one or more energy sources thatilluminate some or all of the target area with light. However, in somecases, the target area is illuminated with natural light and/or ambientlight from the LF display assembly 510 when presenting holographiccontent. The energy source projects light when executing instructionsreceived from the controller 520. The light may be, e.g., a structuredlight pattern, a pulse of light (e.g., an IR flash), or some combinationthereof. The tracking system may project light in the visible band (˜380nm to 750 nm), in the infrared (IR) band (˜750 nm to 1700 nm), in theultraviolet band (10 nm to 380 nm), some other portion of theelectromagnetic spectrum, or some combination thereof. A source mayinclude, e.g., a light emitted diode (LED), a micro LED, a laser diode,a TOF depth sensor, a tunable laser, etc.

The tracking system 580 may adjust one or more emission parameter whenexecuting instructions received from the controller 520. An emissionparameter is a parameter that affects how light is projected from asource of the tracking system 580. An emission parameter may include,e.g., brightness, pulse rate (to include continuous illumination),wavelength, pulse length, some other parameter that affects how light isprojected from the source assembly, or some combination thereof. In oneembodiment, a source projects pulses of light in a time-of-flightoperation.

The camera of the tracking system 580 captures images of the light(e.g., structured light pattern) reflected from the target area. Thecamera captures images when executing tracking instructions receivedfrom the controller 520. As previously described, the light may beprojected by a source of the tracking system 580. The camera may includeone or more cameras. That is, a camera may be, e.g., an array (1D or 2D)of photodiodes, a CCD sensor, a CMOS sensor, some other device thatdetects some or all of the light project by the tracking system 580, orsome combination thereof. In an embodiment, the tracking system 580 maycontain a light field camera external to the LF display assembly 510. Inother embodiments, the cameras are included as part of the LF displaysource/sensor module 514 included in the LF display assembly 510. Forexample, as previously described, if the energy relay element of a lightfield module 512 is a bidirectional energy layer which interleaves bothemissive displays and imaging sensors at the energy device layer 220,the LF display assembly 510 can be configured to simultaneously projectlight fields and record imaging information from the viewing area infront of the display. In one embodiment, the captured images from thebidirectional energy surface form a light field camera. The cameraprovides captured images to the controller 520.

The camera of the tracking system 580 may adjust one or more imagingparameters when executing tracking instructions received from thecontroller 520. An imaging parameter is a parameter that affects how thecamera captures images. An imaging parameter may include, e.g., framerate, aperture, gain, exposure length, frame timing, rolling shutter orglobal shutter capture modes, some other parameter that affects how thecamera captures images, or some combination thereof.

The controller 520 controls the LF display assembly 510 and any othercomponents of the LF display system 500. The controller 520 comprises adata store 522, a network interface 524, a tracking module 526, a viewerprofiling module 528, and a light field processing engine 530. In otherembodiments, the controller 520 comprises additional or fewer modulesthan those described herein. Similarly, the functions can be distributedamong the modules and/or different entities in a different manner thanis described here. For example, the tracking module 526 may be part ofthe LF display assembly 510 or the tracking system 580.

The data store 522 is a memory that stores information for the LFdisplay system 500. The stored information may include displayinstructions, tracking instructions, emission parameters, imagingparameters, a virtual model of a target area, tracking information,images captured by the camera, one or more viewer profiles, calibrationdata for the light field display assembly 510, configuration data forthe LF display system 510 including resolution and orientation of LFmodules 512, desired viewing volume geometry, content for graphicscreation including 3D models, scenes and environments, materials andtextures, other information that may be used by the LF display system500, or some combination thereof. The data store 522 is a memory, suchas a read only memory (ROM), dynamic random access memory (DRAM), staticrandom access memory (SRAM), some other type of memory, or somecombination thereof.

The network interface 524 allows the light field display system tocommunicate with other systems or environments via a network. In oneexample, the LF display system 500 receives holographic content from aremote light field display system via the network interface 524. Inanother example, the LF display system 500 transmits holographic contentto a remote data store using the network interface 524.

The tracking module 526 tracks viewers viewing content presented by theLF display system 500. To do so, the tracking module 526 generatestracking instructions that control operation of the source(s) and/or thecamera(s) of the tracking system 580, and provides the trackinginstructions to the tracking system 580. The tracking system 580executes the tracking instructions and provides tracking input to thetracking module 526.

The tracking module 526 may determine a position of one or more viewerswithin the target area. The determined position may be relative to,e.g., some reference point (e.g., a display surface). In otherembodiments, the determined position may be within the virtual model ofthe target area. The tracked position may be, e.g., the tracked positionof a viewer and/or a tracked position of a portion of a viewer (e.g.,eye location, hand location, etc.). The tracking module 526 determinesthe position using one or more captured images from the cameras of thetracking system 580. The cameras of the tracking system 580 may bedistributed about the LF display system 500, and can capture images instereo, allowing for the tracking module 526 to passively track viewers.In other embodiments, the tracking module 526 actively tracks viewers.That is, the tracking system 580 illuminates some portion of the targetarea, images the target area, and the tracking module 526 uses time offlight and/or structured light depth determination techniques todetermine position. The tracking module 526 generates trackinginformation using the determined positions.

The tracking module 526 may also receive tracking information as inputsfrom viewers of the LF display system 500. The tracking information mayinclude body movements that correspond to various input options that theviewer is provided by the LF display system 500. For example, thetracking module 526 may track a viewer's body movement and/or gestureand assign any various movement as an input to the LF processing engine530. The tracking module 526 may provide the tracking information to thedata store 522, the LF processing engine 530, the viewer profilingmodule 528, any other component of the LF display system 500, or somecombination thereof.

To provide context for the tracking module 526, consider an exampleembodiment of an LF display system 500 that displays a holographiccharacter from an amusement park ride defeating a holographic enemycharacter. For this example, the holographic character is the hero inthe amusement park ride's storyline. In response to the display, aviewer first pumps the air to show their excitement. The tracking system580 may record the movement of the viewer's hands and transmit therecording to the tracking module 526. This may be achieved with atracking system 580 comprised of cameras, depth sensors, or otherdevices that are external to the light field display assembly 510, orwith a display surface which simultaneously projects light field imagesand records images, wherein the images recorded from the display surfacemay be light field images, or any combination of these devices, aspreviously described. The tracking module 526 tracks the motion of theviewer's hands in the recording and sends the input to LF processingengine 530. The viewer profiling module 528, as described below,determines that information in the image indicates that motion of theviewer's hands is associated with a positive response. Accordingly, ifenough viewers are recognized having a positive response, the LFprocessing engine 530 generates appropriate holographic content tocelebrate the hero character's defeat over the enemy character. Forexample, the LF processing engine 530 may project confetti in the scene.

The LF display system 500 includes a viewer profiling module 528configured to access the information obtained by the tracking system580, process the information to identify a viewer of the one or moreviewers, and generate a viewer profile for the viewer (or viewers). Theviewer profiling module 528 generates a profile of a viewer (or viewers)that views holographic content displayed by a LF display system 500. Theviewer profiling module 528 generates a viewer profile based, in part,on viewer input and monitored viewer behavior, actions, and reactions.The viewer profiling module 528 can access information obtained fromtracking system 580 (e.g., recorded images, videos, sound, etc.) andprocess that information to determine various information. Thecontroller 520 (e.g., the LF processing engine 530) generatesholographic content based in part on the generated viewer profile (orviewer profiles) by the viewer profiling module 528. In variousexamples, viewer profiling module 528 can use any number of machinevision or machine hearing algorithms to determine viewer behavior,actions, and reactions. The viewer profiling module 528 can be used inany LF display system in an amusement park (e.g., in an enclosure, in auser station, in a queue, etc.).

More generally, a viewer profile may include any information receivedand/or determined about a viewer viewing holographic content from the LFdisplay system. For example, each viewer profile may log actions orresponses of that viewer to the content displayed by the LF displaysystem 500. Additionally, the LF processing engine may create aninteractive experience by generating additional holographic and/orsensory content for display to the viewers based on the viewer profile.Some example information that can be included in a viewer profile areprovided below.

In some embodiments, the viewer profiling module 528 monitors behaviorof the viewers within, e.g., the amusement park. Monitored behavior mayinclude, e.g., number of times a viewer participates in an amusementpark ride, how long the viewer is willing to wait in line for aparticular amusement park ride, how the viewer responds to certain typesof holographic content (e.g., in a haunted house—what elicits theloudest scream from a user), some other behavior relating to theamusement park ride, or some combination thereof. In some embodiments,the viewing profile may describe behavior for the viewer in the contextof the entire amusement park and/or other amusement parks.

In another example, monitored viewer behavior can include, for example,smiles, cheering, clapping, laughing, fright, screams, excitementlevels, recoiling, other changes in gestures, or movement by theviewers, etc. In some embodiments, the viewer profiling module 528 maydirectly update a viewer profile based on actions and/or responses of aviewer to holographic content displayed by the LF display system 500. Insome embodiments, a viewer profile may describe a response of a viewerwith respect to a displayed holographic character (e.g., an actor, ananimation, etc.), enclosure (e.g., car, room, etc.), etc. For example, aviewer profile may indicate that a viewer generally has a positiveresponse to holographic characters.

In some embodiments, a viewer profile can indicate characteristics of aviewer at an amusement park. For example, a viewer in a queue for anamusement park ride is wearing a sweatshirt displaying a characterassociated with that amusement park. In this case, the viewer profilecan indicate that the viewer is wearing a sweatshirt and may preferholographic content associated with the character who is on thesweatshirt. More broadly, viewer characteristics that can be indicatedin a viewer profile may include, for example, age, gender, ethnicity,clothing, etc.

In some embodiments, a viewer profile can indicate preferences for aviewer in regard to desirable amusement park ride experiences and/oramusement park ride enclosure characteristics. For example, a viewerprofile may indicate that a viewer prefers only to view holographiccontent that is age appropriate for everyone in their family. In anotherexample, a viewer profile may indicate holographic object volumes todisplay holographic content (e.g., on a wall) and holographic objectvolumes to not display holographic content (e.g., above their head). Theviewer profile may also indicate that the viewer prefers to have hapticinterfaces presented near them, or prefers to avoid them.

In another example, a viewer profile indicates subsequent visits for anamusement park ride by a particular viewer. For instance, viewerprofiling module 528 determines that a viewer, or group of viewers, haspreviously attended the amusement park ride. As such the LF displaysystem 500 may display holographic content that is different than theprevious time the viewers attended the amusement park ride. As oneexample, an amusement park ride including holographic content may havethree different endings and LF display system 500 may display differentendings based on the viewers in attendance. In another example, each ofthe three endings may be presented to different viewing volumes in thesame amusement park ride enclosure.

In some embodiments, a viewer profile may also describe characteristicsand preferences for a group of viewers rather than a particular viewer.For example, viewer profiling module 528 may generate a viewer profilefor the riders of an amusement park ride. In one example, viewerprofiling module 528 creates a viewer profile for riders of an amusementpark ride that involves fairy princesses. The profile indicates that60.3% of the viewers are young girls between the age of 2 and 12 andhave a positive response to the amusement park ride. The profile alsoindicates that the remaining 39.7% of the viewers are adults and youngboys and are having a negative reaction to the amusement park ride. Anyof the previously described information and characteristics may beapplied to a group of viewers.

The viewer profiling module 528 may also access a profile associatedwith a particular viewer (or viewers) from a third-party system orsystems to build and/or update a viewer profile. The viewer profilingmodule 528 may be configured to update the viewer profile usinginformation from a social media account of the viewer (or viewers). Thecontroller 520 (e.g., the LF processing engine 530) generatesholographic content based in part on the updated viewer profile (orupdated viewer profiles). For example, a viewer purchases a ticket foran amusement park using a third-party vendor that is linked to thatviewer's social media account. Thus, the viewer's ticket is linked tohis social media account. When the viewer enters the amusement parkusing their ticket, the viewer profiling module 528 can accessinformation from his social media account to build (or augment) a viewerprofile.

In some embodiments, the data store 522 includes a viewer profile storethat stores viewer profiles generated, updated, and/or maintained by theviewer profiling module 528. The viewer profile can be updated in thedata store at any time by the viewer profiling module 528. For example,in an embodiment, the viewer profile store receives and storesinformation regarding a particular viewer in their viewer profile whenthe particular viewer views holographic content provided by the LFdisplay system 500. In this example, the viewer profiling module 528includes a facial recognition algorithm that may recognize viewers andpositively identify them as they view presented holographic content. Toillustrate, as a viewer enters the target area of the LF display system500, the tracking system 580 obtains an image of the viewer. The viewerprofiling module 528 inputs the captured image and identifies theviewer's face using the facial recognition algorithm. The identifiedface is associated with a viewer profile in the profile store and, assuch, all input information obtained about that viewer may be stored intheir profile. The viewer profiling module may also utilize cardidentification scanners, voice identifiers, a radio-frequencyidentification (RFID) chip scanners, barcode scanners, etc. topositively identify a viewer. In one example, viewers may be given abarcode on a wristband. Paired with a barcode scanner, the viewerprofiling module may positively identify the viewer waiting in thequeue. In another example, viewers may be given a RFID chip that canthen be scanned with a RFID scanner to positively identify the viewerwaiting in the queue.

In embodiments where the viewer profiling module 528 can positivelyidentify viewers, the viewer profiling module 528 can determine eachvisit of each viewer to the LF display system 500. The viewer profilingmodule 528 may then store the time and date of each visit in the viewerprofile for each viewer. Similarly, the viewer profiling module 528 maystore received inputs from a viewer from any combination of the sensoryfeedback system 570, the tracking system 580, and/or the LF displayassembly 510 each time they occur. Viewer information that can berecorded with the viewer profiling module 528 may include each visit tothe amusement park (e.g., including time/date or duration of visit),in-park purchases (e.g., price of purchases or items purchased), numberof visits to various rides in the amusement park (e.g., which ride ismost visited), wait times during each visit, frequency between visits toone ride in the amusement park, etc. In some embodiments, an amusementpark may also have tiers of viewers (e.g., regular, season pass holder,or very important person (VIP)). In these embodiments, the trackingsystem may positively identify the viewer. Once the tracking systemaccesses the viewer profile store, the LF display system 500 maydetermine that viewer's status (e.g., as regular, season pass holder, orVIP) and could provide holographic content specific to that viewer'sstatus. The viewer profile store may additionally receive furtherinformation for a viewer from other modules or components of thecontroller 520 which can then be stored with the viewer profile. Othercomponents of the controller 520 may then also access the stored viewerprofiles for determining subsequent holographic content to be providedto that viewer. The viewer profiling module 528 may additionally receivefurther information about a viewer from other modules or components ofthe controller 520 which can then be stored with the viewer profile.Other components of the controller 520 may then also access the storedviewer profiles for determining subsequent holographic content to beprovided to that viewer.

The LF processing engine 530 generates holographic content comprised oflight field data, as well as data for all of the sensory domainssupported by a LF display system 500. For example, LF processing engine530 may generate 4D coordinates in a rasterized format (“rasterizeddata”) that, when executed by the LF display assembly 510, cause the LFdisplay assembly 510 to present holographic content. The LF processingengine 530 may access the rasterized data from the data store 522. TheLF processing engine 530 can also generate sensory instructions requiredto provide sensory content that augments the holographic objects. Asdescribed above, sensory instructions may generate, when executed by theLF display system 500, haptic surfaces, sound fields, and other forms ofsensory energy supported by the LF display system 500. The LF processingengine 530 may access sensory instructions from the data store 522. Inaggregate, the 4D coordinates and sensory data represent holographiccontent as display instructions executable by a LF display system togenerate holographic and sensory content. More generally, holographiccontent can take the form of CG content with ideal light fieldcoordinates, live action content, rasterized data, vectorized data,electromagnetic energy transported by a set of relays, instructions sentto a group of energy devices, energy locations on one or more energysurfaces, the set of energy propagation paths that are projected fromthe display surface, a holographic object that is visible to a viewer oran audience, and many other similar forms.

The LF display system 500 may also generate an interactive viewingexperience. That is, holographic content may be responsive to inputstimuli containing information about viewer locations, gestures,interactions, interactions with holographic content, or otherinformation derived from the tracking module 526 and/or viewer profilingmodule 528. For example, if a holographic object needs to move in acertain direction immediately in response to a viewer interaction, theLF processing engine 530 may update the render of the scene so theholographic object moves in that required direction. This may requirethe LF processing engine 530 to render light fields in real time basedon a 3D graphical scene with the proper object placement and movement,collision detection, occlusion, color, shading, lighting, etc.,correctly responding to the viewer interaction.

The LF display assembly 510 simultaneously projects holographic andsensory content of the amusement park ride experience by executing thedisplay instructions. The LF display system 500 monitors viewerinteractions (e.g., vocal response, touching, etc.) with the presentedamusement park ride content with the tracking module 526 and viewerprofiling module 528. In response to the viewer interactions, the LFprocessing engine may create an interactive experience by generatingadditional holographic and/or sensory content for display to theviewers.

To illustrate, consider an example embodiment of an LF display system500 including a LF processing engine 530 that generates a plurality ofholographic objects representing balloons falling from the ceilingduring an amusement park ride. A viewer may move to touch theholographic object representing the balloon. Correspondingly, thetracking system 580 tracks movement of the viewer's hands relative tothe holographic object. The movement of the viewer is recorded by thetracking system 580 and sent to the controller 520. The tracking module526 continuously determines the motion of the viewer's hand and sendsthe determined motions to the LF processing engine 530. The LFprocessing engine 530 determines the placement of the viewer's hand inthe scene, adjusts the real-time rendering of the graphics to includeany required change in the holographic object (such as position, color,or occlusion). The LF processing engine 530 instructs the LF displayassembly 510 (and/or sensory feedback system 570) to generate a tactilesurface using the volumetric haptic projection system (e.g., usingultrasonic speakers). The generated tactile surface corresponds to atleast a portion of the holographic object and occupies substantially thesame space as some or all of an exterior surface of the holographicobject. The LF processing engine 530 uses the tracking information todynamically instruct the LF display assembly 510 to move the location ofthe tactile surface along with a location of the rendered holographicobject such that the viewer is given both a visual and tactileperception of touching the balloon. More simply, when a viewer views hishand touching a holographic balloon, the viewer simultaneously feelshaptic feedback indicating their hand touches the holographic balloon,and the balloon changes position or motion in response to the touch.

LF processing engine 530 may provide holographic content to display toviewers in a queue before, during, and/or after an amusement park rideto augment the amusement park ride experience. The holographic contentmay be provided by the publisher of the characters involved in theamusement park ride, provided by the amusement park, provided by anadvertiser, generated by a LF processing engine 530, etc. Theholographic content may be content associated with the amusement parkride, the genre of the amusement park ride, the location of theamusement park, advertisements, etc. In any case, the holographiccontent may be stored in the data store 522, or streamed to the LFdisplay system 500 through the network interface 524. For example,viewers of an amusement park ride may have to wait in a queue beforeexperiencing the ride. The queue is augmented with LF display modules.The publisher of the characters involved in the amusement park ride mayprovide holographic content to present on the queue displays before theamusement park ride begins. The LF processing engine 530 accesses theholographic content and presents the accessed content from the displaysin the queue before the amusement park ride begins. In another example,an advertiser has provided holographic content of its products asadvertisements to an amusement park to display to viewers in amusementpark ride queues. The LF processing engine 530 presents theadvertisements to the viewers in the queue. In other examples, asdescribed below, a LF processing engine may dynamically generateholographic content to display in the queues or during the amusementpark rides.

The LF processing engine 500 may also modify holographic content to suitthe enclosure that is presenting the holographic content. For example,not every enclosure is the same size, has the same number of seats, orhas the same technical configuration. As such, LF processing engine 530may modify holographic content such that it will be appropriatelydisplayed in an enclosure. In an embodiment, the LF processing engine530 may access a configuration file of an enclosure including thelayout, resolution, field-of-view, other technical specifications, etc.of the enclosure. The LF processing engine 530 may render and presentthe holographic content based on information included in theconfiguration file.

The LF processing engine 530 may also create holographic content fordisplay by the LF display system 500. Importantly, here, creatingholographic content for display is different from accessing, orreceiving, holographic content for display. That is, when creatingcontent, the LF processing engine 530 generates entirely new content fordisplay rather than accessing previously generated and/or receivedcontent. The LF processing engine 530 can use information from thetracking system 580, the sensory feedback system 570, the viewerprofiling module 528, the tracking module 526, or some combinationthereof, to create holographic content for display. In some examples, LFprocessing engine 530 may access information from elements of the LFdisplay system 500 (e.g., tracking information and/or a viewer profile),create holographic content based on that information, and display thecreated holographic content using the LF display system 500 in response.The created holographic content may be augmented with other sensorycontent (e.g., touch, audio, or smell) when displayed by the LF displaysystem 500. Further, the LF display system 500 may store createdholographic content such that it may be displayed in the future.

Dynamic Content Generation for a LF Display System

In some embodiments, the controller 520 (e.g., the LF processing engine530) incorporates an artificial intelligence (AI) model to createholographic content for display by the LF display system 500. Thecontroller 520 may use information obtained by the tracking system 580and/or the viewer profiling module 528, including updated viewerprofiles, and an AI model to generate holographic content. The AI modelmay include supervised or unsupervised learning algorithms including butnot limited to regression models, neural networks, classifiers, or anyother AI algorithm. The AI model may be used to determine viewerpreferences based on viewer information recorded by the LF displaysystem 500 (e.g., by tracking system 580) which may include informationon a viewer's behavior.

The AI model may access information from the data store 522 to createholographic content. For example, the AI model may access viewerinformation from a viewer profile or profiles in the data store 522 ormay receive viewer information from the various components of the LFdisplay system 500. To illustrate, the AI model may determine a viewerenjoys seeing holographic content including animals. The AI model maydetermine the preference based on a group of viewer's positive reactionsor responses to previously viewed holographic content including animals.That is, the AI model may create holographic content personalized to aset of viewers according to the learned preferences of those viewers.So, for example, the AI model may incorporate animals in the holographiccontent viewed by a group of viewers using the LF display system 500.The AI model may also store the learned preferences of each viewer inthe viewer profile store of the data store 522. In some examples, the AImodel may create holographic content for an individual viewer ratherthan a group of viewers.

One example of an AI model that can be used to identify characteristicsof viewers, identify reactions, and/or generate holographic contentbased on the identified information is a convolutional neural networkmodel with layers of nodes, in which values at nodes of a current layerare a transformation of values at nodes of a previous layer. Atransformation in the model is determined through a set of weights andparameters connecting the current layer and the previous layer. Forexample, and AI model may include five layers of nodes: layers A, B, C,D, and E. The transformation from layer A to layer B is given by afunction W₁, the transformation from layer B to layer C is given by W₂,the transformation from layer C to layer D is given by W₃, and thetransformation from layer D to layer E is given by W₄. In some examples,the transformation can also be determined through a set of weights andparameters used to transform between previous layers in the model. Forexample, the transformation W₄ from layer D to layer E can be based onparameters used to accomplish the transformation W₁ from layer A to B.

The input to the model can be an image taken by tracking system 580encoded onto the convolutional layer A and the output of the model isholographic content decoded from the output layer E. Alternatively oradditionally, the output may be a determined characteristic of a viewerin the image. In this example, the AI model identifies latentinformation in the image representing viewer characteristics in theidentification layer C. The AI model reduces the dimensionality of theconvolutional layer A to that of the identification layer C to identifyany characteristics, actions, responses, etc. in the image. In someexamples, the AI model then increases the dimensionality of theidentification layer C to generate holographic content.

The image from the tracking system 580 is encoded to a convolutionallayer A. Images input in the convolutional layer A can be related tovarious characteristics and/or reaction information, etc. in theidentification layer C. Relevance information between these elements canbe retrieved by applying a set of transformations between thecorresponding layers. That is, a convolutional layer A of an AI modelrepresents an encoded image, and identification layer C of the modelrepresents a smiling viewer. Smiling viewers in a given image may beidentified by applying the transformations W₁ and W₂ to the pixel valuesof the image in the space of convolutional layer A. The weights andparameters for the transformations may indicate relationships betweeninformation contained in the image and the identification of a smilingviewer. For example, the weights and parameters can be a quantization ofshapes, colors, sizes, etc. included in information representing asmiling viewer in an image. The weights and parameters may be based onhistorical data (e.g., previously tracked viewers).

Smiling viewers in the image are identified in the identification layerC. The identification layer C represents identified smiling viewersbased on the latent information about smiling viewers in the image.

Identified smiling viewers in an image can be used to generateholographic content. To generate holographic content, the AI modelstarts at the identification layer C and applies the transformations W₂and W₃ to the value of the given identified smiling viewers in theidentification layer C. The transformations result in a set of nodes inthe output layer E. The weights and parameters for the transformationsmay indicate relationships between an identified smiling viewers andspecific holographic content and/or preferences. In some cases, theholographic content is directly output from the nodes of the outputlayer E, while in other cases the content generation system decodes thenodes of the output layer E into a holographic content. For example, ifthe output is a set of identified characteristics, the LF processingengine can use the characteristics to generate holographic content.

Additionally, the AI model can include layers known as intermediatelayers. Intermediate layers are those that do not correspond to animage, identifying characteristics/reactions, etc., or generatingholographic content. For example, in the given example, layer B is anintermediate layer between the convolutional layer A and theidentification layer C. Layer D is an intermediate layer between theidentification layer C and the output layer E. Hidden layers are latentrepresentations of different aspects of identification that are notobserved in the data, but may govern the relationships between theelements of an image when identifying characteristics and generatingholographic content. For example, a node in the hidden layer may havestrong connections (e.g., large weight values) to input values andidentification values that share the commonality of “laughing peoplesmile.” As another example, another node in the hidden layer may havestrong connections to input values and identification values that sharethe commonality of “scared people scream.” Of course, any number oflinkages are present in a neural network. Additionally, eachintermediate layer is a combination of functions such as, for example,residual blocks, convolutional layers, pooling operations, skipconnections, concatenations, etc. Any number of intermediate layers Bcan function to reduce the convolutional layer to the identificationlayer and any number of intermediate layers D can function to increasethe identification layer to the output layer.

In one embodiment, the AI model includes deterministic methods that havebeen trained with reinforcement learning (thereby creating areinforcement learning model). The model is trained to increase thequality of the amusement park ride using measurements from trackingsystem 580 and/or viewer profiling module 528 as inputs, and changes tothe created holographic content as outputs.

Reinforcement learning is a machine learning system in which a machinelearns ‘what to do’—how to map situations to actions—so as to maximize anumerical reward signal. The learner (e.g. LF processing engine 530) isnot told which actions to take (e.g., generating prescribed holographiccontent), but instead discovers which actions yield the most reward(e.g., increasing the quality of holographic content by making morepeople cheer) by trying them. In some cases, actions may affect not onlythe immediate reward but also the next situation and, through that, allsubsequent rewards. These two characteristics—trial-and-error search anddelayed reward—are two distinguishing features of reinforcementlearning.

Reinforcement learning is defined not by characterizing learningmethods, but by characterizing a learning problem. Basically, areinforcement learning system captures those important aspects of theproblem facing a learning agent interacting with its environment toachieve a goal. That is, in the example of generating a scene for aholographic character, the reinforcement learning system capturesinformation about viewers on the amusement park ride (e.g., age,disposition, etc.). Such an agent senses the state of the environmentand takes actions that affect the state to achieve a goal or goals(e.g., creating a scene for which the viewers will cheer). In its mostbasic form, the formulation of reinforcement learning includes threeaspects for the learner: sensation, action, and goal. The LF processingengine 530 senses the state of the environment with sensors of thetracking system 580, displays holographic content to the viewers in theenvironment, and achieves a goal that is a measure of the viewer'sreception of that scene.

One of the challenges that arises in reinforcement learning is thetrade-off between exploration and exploitation. To increase the rewardin the system, a reinforcement learning agent prefers actions that ithas tried in the past and found to be effective in producing reward.However, to discover actions that produce reward, the learning agentselects actions that it has not selected before. The agent ‘exploits’information that it already knows in order to obtain a reward, but italso ‘explores’ information in order to make better action selections inthe future. The learning agent tries a variety of actions andprogressively favors those that appear to be best while still attemptingnew actions. On a stochastic task, each action is generally tried manytimes to gain a reliable estimate to its expected reward. For example,if the LF processing engine creates holographic content that the LFprocessing engine knows will result in a viewer laughing after a longperiod of time, the LF processing engine may change the holographiccontent such that the time until a viewer laughs decreases.

Further, reinforcement learning considers the whole problem of agoal-directed agent interacting with an uncertain environment.Reinforcement learning agents have explicit goals, can sense aspects oftheir environments, and can choose actions to receive high rewards(i.e., a roaring crowd). Moreover, agents generally operate despitesignificant uncertainty about the environment they face. Whenreinforcement learning involves planning, the system addresses theinterplay between planning and real-time action selection, as well asthe question of how environmental elements are acquired and improved.For reinforcement learning to make progress, important sub problems haveto be isolated and studied, the sub problems playing clear roles incomplete, interactive, goal-seeking agents.

The reinforcement learning problem is a framing of a machine learningproblem where interactions are processed and actions are carried out toachieve a goal. The learner and decision-maker is called the agent(e.g., LF processing engine 530). The thing it interacts with,comprising everything outside the agent, is called the environment(e.g., riders on an amusement park ride, etc.). These two interactcontinually, the agent selecting actions (e.g., creating holographiccontent) and the environment responding to those actions and presentingnew situations to the agent. The environment also gives rise to rewards,special numerical values that the agent tries to maximize over time. Inone context, the rewards act to maximize viewer positive reactions toholographic content. A complete specification of an environment definesa task which is one instance of the reinforcement learning problem.

To provide more context, an agent (e.g., LF processing engine 530) andenvironment interact at each of a sequence of discrete time steps, i.e.t=0, 1, 2, 3, etc. At each time step t the agent receives somerepresentation of the environment's state s_(t) (e.g., measurements fromtracking system 580). The states s_(t) are within S, where S is the setof possible states. Based on the state s_(t) and the time step t, theagent selects an action at (e.g., making the holographic character dothe splits). The action at is within A(s_(t)), where A(s_(t)) is the setof possible actions. One time state later, in part as a consequence ofits action, the agent receives a numerical reward r_(t+1). The statesr_(t+1) are within R, where R is the set of possible rewards. Once theagent receives the reward, the agent selects in a new state s_(t+1).

At each time step, the agent implements a mapping from states toprobabilities of selecting each possible action. This mapping is calledthe agent's policy and is denoted π_(t) where π_(t)(s,a) is theprobability that a_(t)=a if s_(t)=s. Reinforcement learning methods candictate how the agent changes its policy as a result of the states andrewards resulting from agent actions. The agent's goal is to maximizethe total amount of reward it receives over time.

This reinforcement learning framework is flexible and can be applied tomany different problems in many different ways (e.g. generatingholographic content). The framework proposes that whatever the detailsof the sensory, memory, and control apparatus, any problem (orobjective) of learning goal-directed behavior can be reduced to threesignals passing back and forth between an agent and its environment: onesignal to represent the choices made by the agent (the actions), onesignal to represent the basis on which the choices are made (thestates), and one signal to define the agent's goal (the rewards).

Of course, the AI model can include any number of machine learningalgorithms. Some other AI models that can be employed are linear and/orlogistic regression, classification and regression trees, k-meansclustering, vector quantization, etc. Whatever the case, generally, theLF processing engine 530 takes an input from the tracking module 526and/or viewer profiling module 528 and a machine learning model createsholographic content in response. Similarly, the AI model may direct therendering of holographic content.

In an example, the LF processing engine 530 presents holographic contentthat includes a holographic character. The sensory feedback system 570may comprise at least one sensory feedback device that is configured toprovide sensory feedback as the holographic character is presented. Thesensory feedback includes tactile feedback, audio feedback, aromafeedback, temperature feedback, any other type of sensory feedback, orany combination thereof. The sensory feedback system 570 may providetactile feedback by providing a tactile surface coincident with asurface of the holographic character that the one or more viewers mayinteract with via touch. The tracking system 580 comprises one or moretracking devices configured to obtain information about the one or moreviewers, and the controller 520 (e.g., the LF processing engine 530) maybe configured to generate the holographic character for the one or moreviewers of the amusement park ride based on the information obtained bythe tracking system 580. Information obtained by the tracking system 580includes any of a position of the viewer, a movement of the viewer, agesture of the viewer, an expression of the viewer, a gaze of the viewer(i.e., gaze direction), an age of a viewer, a gender of the viewer, anidentification of a piece of a garment worn by the viewer, and anauditory feedback of the viewer. In some embodiments, the trackedinformation includes the gaze of the viewer, and the controller 520(e.g., the LF processing engine 530) is configured to update eyes of theholographic character to maintain eye-contact with the gaze of theviewer. In some embodiments, the tracked information includes therespective gazes of a plurality of viewers, the controller 520 (e.g.,the LF processing engine 530) and configured to update eyes of theholographic character to alternate directing eye-contact between theplurality of viewers. The controller 520 (e.g., the LF processing engine530) is configured to use the information obtained by the trackingsystem 580 and an AI model to generate holographic content.

The LF processing engine 530 may create the holographic character usinginformation included in the viewer profiles stored in the data store522. The viewer profiling module 528 is configured to access theinformation obtained by the tracking system 580, process the informationto identify a viewer of the one or more viewers of the amusement parkride, and generate a viewer profile for the viewer. The controller 520(e.g., the LF processing engine 530) may be configured to generate theholographic character for the viewer based in part on the viewerprofile. For example, information included in stored viewer profilesindicates that a large number of viewers enjoy scenes involving animalsand particularly enjoy scenes involving dogs. As such, the LF processingengine 530 creates a holographic character that is displayed by the LFdisplay system 500 as a big, fluffy white dog. More explicitly, LFprocessing engine 530 accesses the viewer profiles of the viewers in anamusement park ride enclosure. LF processing engine 530 parameterizes(e.g., quantifies) information in each viewer profile. For example, LFprocessing engine 530 can quantify characteristics such as the age,location, gender, etc. of a viewer. Further, LF processing engine 530can parameterize other information included in a viewer profile. Theviewer profiling module 528 may be further configured to update theviewer profile using information from a social media account of theviewer and the controller 520 (e.g., the LF processing engine 530) isconfigured to generate the holographic character based in part on theupdated viewer profile. For example, if a viewer profile indicates thata viewer has posted pictures of dogs to their social media and discussedsupporting animal shelters and pet adoptions on their social media, thecontent creation module may quantify this tendency (e.g., generates ascore indicating a viewer's interest in dogs). The controller 520 (e.g.,the LF processing engine 530) is configured to use the viewer profile(an updated viewer profile) and an AI model to generate holographiccontent. For example, the parameterized user profiles are input into anAI model (e.g., a neural network) configured to generate characteristicsof a holographic character based on input parameters and receivescharacteristics for the holographic character in response. LF processingengine 530 then inputs the characteristics for the holographic characterinto an AI model (e.g., a procedural generation algorithm) configured togenerate a holographic character given a set of characteristics andgenerates a holographic dog that is big, fluffy, and white in response.Further the LF processing engine 530 can create holographic content(e.g., scenarios for, friends of, etc.) that would adhere to the personaof the holographic dog. For example, the content generation module 530may create a scenario for the holographic dog about looking for a hiddendog bone. More explicitly, LF processing engine 530 may access thecharacteristics of the holographic dog and information about the viewersand input that information into an AI model (e.g., a recurrent neuralnetwork “RNN”). Again, the characteristics and information may beparameterized (e.g., using a classification and regression tree) andinput into the RNN. Here, the RNN may be trained using real-world dogswith similar input parameters. As such, the RNN generates behaviors forthe holographic dog, such as air-scenting, panting, tail wagging, etc.,to the viewers in an amusement park ride enclosure that share similarcharacteristics to behaviors of real-world dogs.

LF processing engine 530 can create holographic content based on thetheme of the amusement park ride. For example, the theme of theamusement park ride may be associated with a set of metadata describingthe amusement park ride's characteristics. The metadata may include, forexample, the setting, genre, characters, content, themes, titles, etc.LF processing engine 530 may access any of the metadata describing theamusement park ride and generate holographic content to present in thequeue for the amusement park ride in response. For example, an outerspace themed amusement park ride has a queue augmented with a LF displaysystem 500. The LF processing engine 530 accesses the metadata of theamusement park ride to create holographic content for the queue beforethe amusement park ride begins. Here, the metadata includes that thesetting is outer space and the genre is adventure. The LF processingengine 530 inputs the metadata into an AI model and receives holographiccontent to display on the LF display modules of the queue in response.In this example, the LF processing engine 530 creates a star and planetfilled sky to display on the LF display modules of the queue before theamusement park ride.

In an example, the LF processing engine 530 creates holographic contentbased on the viewers present at the amusement park ride including a LFdisplay system 500. For example, a group of viewers enters an enclosureof an amusement park ride augmented by holographic content displayed bythe LF display system 500. Viewer profiling module 528 generates viewerprofiles for the viewers in the enclosure of the amusement park ride andan aggregate viewer profile representing all of the viewers in theenclosure. The viewer profiling module 528 is configured to access theinformation obtained by the tracking system 580, process the informationto identify the one or more viewers of the amusement park ride, andgenerate an aggregate viewer profile for the one or more viewers. Thecontroller 520 (e.g., the LF processing engine 530) is configured togenerate the holographic content for the one or more viewers based inpart on the aggregate viewer profile. The viewer profiling module 528 isfurther configured to update the aggregate viewer profile usinginformation from at least one or more social media accounts of the oneor more viewers and the controller 520 (e.g., the LF processing engine530) is further configured to generate holographic content based in parton the updated aggregate viewer profile. The aggregate viewer profile isa profile that includes information (e.g., an aggregate of viewercharacteristics, an aggregate of viewer demographics, etc.) from one ormore viewers social media accounts. LF processing engine 530 accessesthe aggregate viewer profile and creates holographic content to displayto the viewers in the enclosure. For example, the viewers in theenclosure are families with young children, and, therefore, theaggregate viewer profile includes information indicating that they mayenjoy holographic content commensurate of families with young children(e.g., through parameterization and input into an AI model). As such,the LF processing engine 530 generates holographic content such that theenclosure has a more bright and cheerful atmosphere (e.g., colorful,bright lighting, animations, upbeat music, etc.).

In an example, the LF processing engine 530 creates holographic contentbased on the responses of viewers during an amusement park ride. Forexample, viewers in an enclosure of the amusement park ride are viewingcontent augmented by a LF display system 500. The tracking module 526and the viewer profiling module 528 monitor the reaction of the viewersduring the amusement park ride. For example, tracking module 526 mayobtain images of viewers as they view content of the amusement parkride. Tracking module 526 identifies the viewer, and viewer profilingmodule 528 may use machine vision algorithms to determine a reaction ofthe viewer based on information included in the image. For example, anAI model can be used to identify if a viewer viewing the content of theamusement park ride is smiling and, accordingly, viewer profiling module528 can indicate in the viewer profile if the viewer has a positive ornegative response to the content based on the smile. Other reactions mayalso be determined. The tracking module may determine information aboutviewers including the position of the viewer, a movement of the viewer,a gesture of the viewer, an expression of the viewer, an age of theviewer, a gender of the viewer, an identification of a some or all of apiece of a garment worn by the viewer (e.g., a hoodie with a universitylogo on it), or an auditory feedback of the viewer (e.g., a laughingresponse of the viewer). This information may be shared with the viewerprofiling module 528 to generate a viewer profile. By way ofillustration, LF processing engine 530 generates scary content for ahaunted house amusement park ride. As the LF display system 500 displaysthe scary content, the tracking system 580 and viewer profiling module528 monitor the reactions of the viewers. In this instance, the viewersare not screaming at the ghost and goblin content being presented. Inresponse, the LF processing engine 530 modifies the scary content suchthat the imagery becomes more graphic and the lighting darker. Here, LFprocessing engine 530 may input the reactions into an AI model (e.g., areinforcement learning model) configured to induce screams in viewersviewing the holographic content. Based on the responses andcharacteristics of viewers on the amusement park ride, the LF processingengine 530 changes the approach to presenting scary content. Here, themodel may be trained using previously presented scary content andrecorded viewer responses to that content.

In a similar example, the LF processing engine 530 may createholographic content based on previously existing or providedadvertisement content. That is, for example, the LF processing engine530 can request an advertisement from a network system via networkinterface 524, the network system provides the holographic content inresponse, and the LF processing engine 530 creates holographic contentfor display including the advertisement. Some examples of advertisementcan include, products, text, videos, etc. Advertisements may bepresented to specific viewing volumes based on the viewers in thatviewing volume. Similarly, holographic content may augment a queue foran amusement park ride with an advertisement (e.g., a productplacement). Most generally, the LF processing engine 530 can createadvertisement content based on any of the characteristics and/orreactions of the viewers in the queue as previously described.

The preceding examples of creating content are not limiting. Mostbroadly, LF processing engine 530 creates holographic content fordisplay to viewers of a LF display system 500. The holographic contentcan be created based on any of the information included in the LFdisplay system 500.

Amusement Park Examples

FIG. 6A is an illustration of a LF display system 600 implemented aspart of an amusement park ride presenting holographic content to one ormore viewers, in accordance to an embodiment. The LF display system 600is an embodiment of the LF display system 500. The LF display system 600contains an enclosure 610 with at least one LF display surface formed bya plurality of LF display modules 620. The enclosure 610 encloses theviewing volume for presenting holographic content to the one or moreviewers. The plurality of LF display modules 620 are tiled together onone or more surfaces to form a seamless surface environment. In someembodiments, the plurality of LF display modules 620 are coincident to awall, a floor, a ceiling, or some combination thereof (as illustrated inFIG. 4B). In one or more embodiments, the enclosure 610 comprises one ormore user stations 615 that are configured to be occupied by one or moreviewers (e.g., can seat one or more viewers of the amusement park ride).In some embodiments, the user station is configured to be occupied bythe viewer and to move relative to the one or more LF display modules.The LF display system 600 is configured to generate holographic contentbased in part on relative movement between the user station and one ormore LF display modules. In other embodiments, the user stations 615move along a path within the enclosure 610. In other embodiments, the LFdisplay assembly moves relative to the user station. The LF displaysystem 600 also includes a LF display assembly (i.e., the LF displayassembly 510) for generating holographic content to the viewers of theamusement park ride. The LF display system 600 may also include anycombination of the other components of the LF display system 500 such asthe sensory feedback system 570, the tracking system 580, and thecontroller 520.

The enclosure 610 of the LF display system 600 encloses a viewing volumefor displaying holographic objects to one or more viewers. The viewingvolume can have varying shapes and dimensions based in part on thedesign of the LF display system 600. In one embodiment, the enclosure610 is a room that may comfortable fit one or more viewers standing orsitting. In another embodiment, the enclosure 610 may be sized as a userstation with one or more physical objects for viewers to be seated. Insome embodiment, the enclosure 610 is sized such that users may walkunconstrained around the enclosure 610 interacting with variousholographic objects generated by the LF display assembly (i.e., the LFdisplay assembly 510). The enclosure 610 may be determined by aplurality of walls that enclose the space of the enclosure 610. In theillustration of FIG. 6A, the enclosure 610 is a room with four wallswith a floor and a ceiling. Note that in other embodiments, the geometryof the enclosure may be different (e.g., cylindrical or walls andceiling form a dome). Of the surfaces that enclose the enclosure 610, atleast one or more are configured as part of the LF display assembly as amulti-sided surface environment. In the illustration of FIG. 6A,although only one wall is shown with the LF display modules 620, inother embodiments, all walls, floor, and ceiling may contain LF displaymodules. The LF display modules 620 may form a multi-sided seamlesssurface environment (e.g., a six-sided seamless surface environment).The multi-sided surface environment includes LF display modules 620 forgenerating holographic content. In some embodiments, all surfaces of theenclosure 610 including the four walls, ceiling, and floor areintegrated as part of the LF display assembly and configured as part ofthe six-sided seamless surface environment, (e.g., as illustrated inFIG. 4B). The six-sided seamless surface environment is advantageous, inthat the viewers may freely gaze around the enclosure 610 while beingfully immersed in holographic content. In one example, the LF displaysystem 600 presents an outer space adventure for viewers. In thisexample the enclosure 610 may be sized to hold a crew of five or sixviewers. In some additional embodiments, the enclosure 610 containsother physical objects that can be transformed with the LF displayassembly. For example, the enclosure 610 comprises a dashboard displaysurface of the user station 615. The dashboard display surface comprisesa LF display assembly which presents at least one holographic objectsuch as a two-dimensional object, a three-dimensional object, a controlbutton, a control switch, a control dial, a steering control interface,an instrument cluster, a volume control interface, a computer interface,a shifter, some other control interface, some other holographic object,or some combination thereof. Following the above example, the enclosure610 of the outer space adventure may have a blank dashboard (not shown)that sits directly in front of the user stations 615 that can betransformed into a spaceship dashboard with the LF display assembly.

In some embodiments, the user stations 615 of the LF display system 600are structures occupied by the viewers of the LF display system 600. Forexample, the LF display system 600 may alternatively use a chair (asillustrated in FIG. 6A), a bench, a stool, a cart, a carriage, avehicle, a standing console, some other physical structure to beoccupied by the viewers, or some combination thereof. In embodiments,the viewers may be unrestrained from moving freely in and out of theuser stations 615 or may be restrained with a harness or safety beltthroughout the ride.

In additional embodiments, the user stations 615 may be configured aspart of a sensory feedback system (i.e., the sensory feedback system570). The LF display system 600 may motorize the user stations 615 orportions of the enclosure 610 for adding movement (e.g., up to sixdegrees of freedom) of the user stations 615 during the amusement parkride. In some embodiments, the user stations 615 are configured to moveand the one or more LF display modules 620 are stationary. The userstations 615 may be a motor-controlled chair, a motor-controlled bench,a motor-controlled stool, a motor-controlled cart, a carriage, avehicle, a motor-controlled floor, a motor-controlled platform, someother motor-controlled physical structure to be occupied by the viewers,or some combination thereof. In other embodiments, the one or more LFdisplay modules 620 are configured to move and the user stations 615 isstationary. In the outer space adventure example, the motor-controlledchairs may be used to, e.g., simulate acceleration and/or decelerationof the spaceship by rocking the chair backwards and forwards,respectively. The motor-controlled chairs may also shake the viewers tosimulate an enemy ship firing at the spaceship causing damage to thespaceship. The LF display system 600 may further incorporate othersensor feedback devices into the user stations 615 to further immerseviewers in the amusement park ride. In some embodiments, the LF displaysystem 600 incorporates some combination of audio feedback devices,temperature feedback devices, aroma feedback devices, tactile feedbackdevices, wind generators, some other feedback device, or somecombination thereof in the user stations 615. The various sensoryfeedback devices may be components of the LF display assembly, anadditional sensory feedback system (i.e., the sensory feedback system570), or both. In the outer space adventure example, the sensoryfeedback devices may include speakers on the chairs for signaling analarm due to an approaching unidentified spaceship or an enemyspaceship. The chairs may also be rigged with wind generators that cansimulate a sprung leak on the spaceship.

The LF display assembly comprises the multi-sided surface environmentconsisting of LF display modules 620 to generate holographic content forthe amusement park ride. Each LF display module of the LF displaymodules 620 that comprise the LF display assembly is an embodiment ofthe LF display module 110 and the LF display module 210. In oneembodiment, the LF display assembly may include LF display modules 620that all are configured to produce and utilize light to generate theholographic content. In another example, the LF display assembly mayinclude LF display modules 620 of at least two different types—some thatare configured to produce and use light energy and some that areconfigured to produce and use acoustic energy. In other embodiments, theLF display assembly may additionally incorporate other sensory feedbackdevices.

Following the outer space adventure example, the LF display assembly maytransform the enclosure 610 into a cabin of a spaceship with a window infront of the user stations 615. Note that the window may be aholographic object that is projected into the viewing volume in alocation between the user stations 615 and the wall of LF displaymodules 620. In this embodiment, the viewers could look through theholographic object (i.e., the window) into space. Moreover, space andthe objects therein could be represented from infinity up to theholographic object. In some embodiments, the LF display assembly maydisplay various command modules all around the enclosure 610 simulatinga spaceship. Additionally, the LF display assembly may generateholographic content such as asteroids or other spaceships (which mayinclude background 2D visual content). The LF display assembly may alsodisplay holographic content on any physical object in the enclosure 610.For example, the LF display assembly may transform the view for peoplesitting on user stations 615 to be the view one would have from seats ona spaceship. In the example with the blank dashboard, the LF displayassembly may transform the dashboard into a spaceship dashboard withvarious buttons, displays, sliders, graphs, etc. The physical dashboardmay also have pressure sensors integrated so as to record any forceapplied that can translate to a viewer pressing a button on theholographic dashboard. Alternatively, the tracking system (i.e., thetracking system 580) can track body movement of the viewers as one ormore of the viewers interact with the holographic dashboard. Inresponse, the LF display system may respond with content according tothe viewers' inputs. For example, in response to pressing a “firemissile” button on the holographic dashboard, the LF display system maygenerate holographic content through the spaceship's window showing amissile being fired at an enemy spaceship. Additionally, the LF displaysystem may present audio content corresponding to a missile being firedfrom the spaceship.

In other examples, the LF display system 600 may be used to simulateother various interactive experiences, such as a safari adventure or anunderwater excursion. In the example of the safari adventure, the LFdisplay system 600 may generate holographic objects to transform theview for people sitting on user stations 615 to be consistent with theview from within a jeep or similar vehicle. The frame of the jeep mayalso be displayed as a holographic object by the LF display system 600.Additionally, the LF display system 600 may motorize the user stations615 so as to mimic movement of the vehicle whilst traversing the safari.The LF display system 600 may generate holographic objects such assafari animals or trees as the jeep traverses the safari. In one or moreportions of the safari adventure, the viewers may be asked to movefreely about the enclosure 610. During these portions of time, theviewers may move around the enclosure 610 interacting with variousholographic objects placed around the enclosure 610. The LF displaysystem 600 may additionally utilize a tracking system (i.e., thetracking system 580) to track viewer movement for updating holographicobjects to track with the viewer movement. For example, a holographiczebra may walk alongside a viewer's movement around the enclosure 610.The LF display system 600 may additionally provide sensory stimuli tobetter immerse the viewers. Additional sensory stimuli for the safariadventure may include an increase in heat within the enclosure 610,occasional winds blowing through the enclosure 610, or audio cues of thevarious safari animals.

The LF display system 600 provides an improved system for displaycontent in amusement park rides compared to conventional systems. The LFdisplay system 600 may utilize LF display modules 620 all around theenclosure 610 to form a six-sided seamless surface environment forgenerating holographic content. Compared to conventional amusement parkrides where viewers would simply be seated in front of an electronicdisplay that presented 2D content or 3D stereoscopic content, the LFdisplay system 600 generates holographic content including holographicobjects that have different viewable perspectives when looking at theholographic objects from various points of view. Moreover, with 3Dstereoscopic content, viewers are required to wear eyewear devices formerging the stereoscopic images. The LF display system 600 allows forviewers to view the holographic content without need for eyewear devicesor VR/AR Headsets.

FIG. 6B is an illustration of a LF display system 650 in a cylindricalgeometry that is implemented as part of an amusement park ridepresenting holographic content to one or more viewers 655, in accordanceto an embodiment. The LF display system 650 is an embodiment of the LFdisplay system 500 and may additionally include other various componentssuch as any of the components in the LF display system 500. In the LFdisplay system 650, holographic content is projected by a series of LFmodules 620 which may be placed on the floor, on the walls, and on theceiling of an enclosure 610. In this embodiment, the geometry of theenclosure 610 is such that the LF display system 650 has a cylindricalconfiguration. Throughout the enclosure 610, the LF display system 650provides holographic content to viewers 655. In some embodiments, theholographic content provides a simulated environment that appears to bethe same size as or smaller than the enclosure 610 with holographicobjects being presented in front of a plane of at least one LF displaysurface (e.g., the display area 150). For example, the LF display system650 provides holographic content that simulates one or more walls withinthe enclosure 610. In other embodiments, the holographic contentprovides a simulated environment that appears larger than the actualdimensions of the enclosure 610 with holographic objects being presentedwithin the holographic object volume of the LF display surfaces,including in front of the plane of at least one LF display surface,behind the plane of at least one LF display surface (e.g., the displayarea 150), and split by the plane of at least one LF display surface.For example, the LF system 650 is configured to present an oceanexperience, offering holographic content including water, coral reefs, ashipwreck, and fish on the walls, ceiling, and floor of the enclosure610. Viewers are provided a holographic experience of being underwater,with fish appearing to swim from infinity to suspension before theviewers 655. In another example, the LF display system 650 presents anextended environment far beyond the confines of the enclosure forviewers that wish to move around and explore the extended environment.This may be achieved with content that offers gradual space alterationsand floor remapping to allow the viewer to feel that he or she is in alarge space (or even a space with infinite extent) which dynamicallyadjusts to the motion of the viewer.

The LF display system 650 comprises a sensory feedback system (i.e., thesensory feedback system 570) comprising at least one sensory feedbackdevice that is configured to provide sensory feedback as the holographiccontent is presented. The sensory feedback can include movementfeedback, tactile feedback, audio feedback, aroma feedback, temperaturefeedback, some other type of feedback, or any combination thereof. Insome embodiments, the LF display assembly is configured to generate atactile surface in a local area of the LF display assembly 650. Thetactile surface may be coincident with a surface of at least one of theone or more holographic objects. The LF display system 650 may have atracking system (i.e., the tracking system 580) comprising one or moretracking devices configured to obtain information about the one or moreviewers 655 of the amusement park ride and wherein the controller isconfigured to generate the holographic content for the one or moreviewers 655 based on the information obtained by the tracking system.The information obtained by the tracking system includes any of aposition of the viewer, a movement of the viewer, a gesture of theviewer, an expression of the viewer, an age of the viewer, a gender ofthe viewer, an identification of a piece of a garment worn by theviewer, and auditory feedback of the viewer. For example, when thetracked information is a gaze of the viewer, the LF display system 650is configured to perform an action (e.g. adjusts a holographic object,adjusts a control interface, adjusts an arrangement of the one or moreholographic objects, some other adjustment action, or some combinationthereof) based on the gesture. In another example, the controller isconfigured to use the information obtained by the tracking system and anAI model to generate holographic content. The LF display system 650comprises a viewer profiling module (i.e., the viewer profiling module528) configured to access the information obtained by the trackingsystem, process the information to identify a viewer of the one or moreviewers of the enclosure, and generate a viewer profile for the viewer.The controller is configured to generate the holographic character forthe viewer based in part on the viewer profile. In one embodiment, thecontroller is configured to use the viewer profile and an AI model togenerate holographic content. The viewer profiling module may be furtherconfigured to update the viewer profile using information from a socialmedia account of the viewer and the controller is configured to generatethe holographic character based in part on the updated viewer profile.In other embodiments, the controller is configured to use the viewerprofile (an updated viewer profile) and an AI model to generateholographic content.

In an embodiment, the LF display assembly includes at least one LFdisplay module that has a bidirectional LF display surface whichsimultaneously projects holographic objects and senses light from alocal area adjacent to the LF display modules 620. A bidirectional LFdisplay surface may simultaneously project energy and sense energy fromthe display surface. In some embodiments, the bidirectional LF displaysurface may simultaneously project a light field and record a lightfield from the area in front of the display surface formed by the LFdisplay modules. In an embodiment, this bidirectional display surfacemay comprise a seamless energy surface 360 shown in FIG. 3B whichcontains both emissive light source sites and light sensor sitesunderneath the waveguide elements 370. Other arrangements are alsopossible.

FIG. 7 is an illustration of a LF display system 700 implemented as partof an amusement park queue presenting content to one or more viewers inthe queue, in accordance to an embodiment. The LF display system 700 maybe an embodiment of the LF display system 500. In other embodiments, theLF display system 700 may be implemented as part of any other queue inan amusement park, e.g., a queue for an amusement park ride, a queue fora food stand, a queue for a bathroom, a queue for a camera stand or aqueue to a help desk stand. The LF display system 700 includes a queueof viewers—including a first viewer 705, a second viewer 710, and athird viewer 715—with a LF display assembly (an embodiment of the LFdisplay assembly 510) for generating holographic objects to one or moreviewers of the amusement park queue. The LF display assembly includesone or more LF display modules (embodiments of the LF display modules110 and 210) placed on either or both sides of the queue. In theillustration of FIG. 7, the LF display system 700 has one LF displaymodule 720 on one side of the queue.

As with the LF display systems discussed above, the LF display system700 utilizes the LF display module 720 to generate holographic contentto viewers of the amusement park queue. The LF display system 700presents the holographic content to one or more viewers located in theviewing volume. The viewing volume includes a viewing sub-volume, andthe LF display modules 720 present the holographic content to a viewerlocated in the viewing sub-volume. In this example, the presentedholographic content is visible from inside the viewing sub-volume and isnot visible from outside the viewing sub-volume. As viewers wait in thequeue, the LF display assembly using the LF display module 720 presentsholographic object 725 to viewers in the queue. Similar to the LFdisplay systems discussed above, the LF display system 700 mayincorporate other sensory feedback devices for providing sensory stimuliin complement to the holographic content. In some embodiments, a viewingsub-volume 730 is a portion of the viewing volume of the LF displaymodule 720 which may be used to limit visibility of the holographicobjects 725 displayed by the LF display assembly. For example, onlyviewers standing within the viewing sub-volume 730 (e.g., the firstviewer 705 but not the second viewer 710 nor the third viewer 715) canview the holographic objects 725. In one example, the LF display module720 may display a holographic content that includes a holographiccharacter themed according to the amusement park ride (e.g., a robot ora character from a movie). The holographic character may interact withthe viewers (e.g., look at, speak to, listen to, touch, or somecombination thereof). In another example, the LF display module 720 maydisplay a questionnaire to the viewers with which the viewers mayprovide their responses, e.g., verbal responses recorded by an acousticreceiving device, physical movements recorded by a camera of a trackingsystem, or force applied on physical objects recorded by pressuresensors of a sensory feedback system. Similar to the holographicdashboard described above in FIG. 6A, the LF display module 720 mayreceive user input through implementing a tracking system (i.e., thetracking system 580) and/or a sensory feedback system (i.e., the sensoryfeedback system 570).

In some embodiments, the LF display system 700 includes a trackingsystem (i.e., the tracking system 580). The tracking system may comprisea source assembly and/or a camera assembly for tracking viewers waitingin the queue. The tracking system is configured to track responses of aviewer of the one or more viewers to the presented holographic contentwithin the viewing volume and the controller of the LF display system700 is configured to update the presented holographic content based onthe tracked response (e.g., a position of the viewer, a movement of theviewer, a gesture of the viewer, an expression of the viewer, a gaze ofthe viewer, and auditory feedback of the viewer, some other trackedresponse, or some combination thereof). The tracking system tracksmovement of viewers in the viewing volume of the LF display system 700.The tracking system may make use of viewers' body movements forrendering new holographic content. In some embodiments, a viewer's bodymovements may correspond to user inputs in response to presentedholographic content. For example, as the viewer is prompted with aholographic questionnaire, the viewer may respond by pointing a fingerat an option in the holographic questionnaire. The tracking system maytrack the finger position as a selection of one or more of the optionsin the holographic questionnaire. In other embodiments, the controllerof the LF display system 700 uses the information obtained by thetracking system and an AI model to generate the holographic content. Infurther embodiments, the tracked response of the viewer includes thegaze of the viewer and the LF display assembly is configured to updateeyes of the holographic character to maintain eye-contact with the gazeof the viewer. In other embodiments, the tracked response includes thegazes of a plurality of viewers and the LF display assembly isconfigured to update the holographic character's eyes to alternatedirecting eye-contact between the plurality of viewers. In someadditional embodiments, the tracking information may be considered withaudio recorded by an acoustic receiving device of the sensory feedbacksystem (i.e., the sensory feedback system 570). The LF display system700 can further identify who within a group of viewers is currentlyspeaking and may determine to re-render the holographic character's eyesto make eye-contact with the viewer whom is speaking. In even furtherembodiments, the LF display system 700 may render additional content inresponse to tracking information. The LF display system 700 may alsoprovide sensory feedback (e.g., tactile feedback, aroma feedback,temperature feedback, or some other type of sensory feedback) accordingto the tracking information. For example, the LF display assembly mayrender the holographic character to touch a viewer. Accordingly, the LFdisplay assembly may generate an acoustic pressure wave via anultrasonic emitter to simulate tactile touch from a portion of theholographic character and/or the sensory feedback system may simulatethe touch of the holographic character by providing a tactile surfacecoincident with a surface of the holographic character. For example, theholographic character is a furry monster and viewers may touch or betouched by the furry monster (e.g., viewer would feel coarse, shorthair).

In some embodiments, the LF display system 700 includes a viewerprofiling module (i.e., the viewer profiling module 528). The viewerprofiling module logs each viewer visiting the amusement park ride forpersonalized holographic content in subsequent visits. The viewerprofiling module is configured to identify a viewer of the one or moreviewers within the viewing volume and generate a viewer profile for theviewer. The controller of the LF display system 700 generates theholographic content for the viewer based in part on the viewer profile.In other embodiments, the controller uses the viewer profile and an AImodel to generate the holographic content. The viewer profiling modulemay include sensors for identifying the viewers as they wait in thequeue. These sensors may include facial recognition scanners or cardidentification scanners. In some examples, viewers may be given somephysical identification token such as a barcode on a wristband. Pairedwith a barcode scanner, the viewer profiling module may positivelyidentify the viewer waiting in the queue. Viewer profile includesinformation about the holographic preferences of the viewer, the in-parkpurchases of the viewer, the status of the viewer, the frequency ofvisiting each ride in the amusement park of the viewer, the wait timesof the viewer for each amusement park ride, the frequency between visitsto one particular ride in the amusement park of the viewer, some otherinformation about the viewer, or some combination thereof. In someembodiments, an amusement park may have tiers of viewers (e.g., regular,season pass holder or very important person (VIP)). In theseembodiments, the tracking system 700 may additionally determine aviewer's status (e.g., as regular, season pass holder, or VIP) andprovide holographic content specific to that viewer's status. Forexample, a viewer that is a VIP can be presented with bonus holographiccontent or the LF display system 700 may capture an image free of chargefor the VIP viewer.

In some embodiments, the viewer profiling module may suggest anotheramusement park ride to an identified viewer. The viewer profiling modulemay identify an approximate wait time for viewers in the queue. Theviewer profiling module may then coordinate with an LF display system ofanother amusement park ride to compare approximate queue wait times. TheLF display system 700 may then evaluate whether or not to suggest tosubsequent viewers entering the queue that another amusement park ridehas a lesser wait time. Additionally, the LF display system 700 mayaccess the viewer profile of an identified viewer. Upon accessing theviewer profile, the LF display system 700 presents holographic contentthat includes personalized holographic content, amusement park ridesuggestions, an amusement park ride wait time, or some combinationthereof.

In some additional embodiments, the viewer profiling module may buildviewer profiles for each of the viewers to store viewer preferences orother viewer characteristics. The viewer profiles may be built with thetracking system or with another component of the LF display system 700such as a controller (i.e., the controller 520) and stored in a datastore (i.e., the data store 522). The viewer profiles may be built foreach viewer with all the data collected by the viewer profiling module.Additionally, other components such as a tracking system or sensoryfeedback system may provide data to the viewer profile to be stored inthe viewer profile store.

The LF display system 700 may utilize the viewer profiling module topersonalize holographic content to the viewer during each subsequentvisit to the amusement park ride. For example, the LF display system 700addresses the viewer by name (e.g., visually or audio-wise). In otherexamples, the LF display system 700 generates holographic contentcorresponding to the viewer's response to previously generatedholographic content. Alternatively, the viewer profiling module may beused in the amusement park ride to enhance the amusement park ride.Following the safari adventure example, a viewer in the queue may beprompted by the LF display system 700 regarding the viewer's animalpreferences. In the safari adventure, the LF display system 600 can thengenerate holographic content according to the provided animalpreferences for that viewer.

The LF display system 700 provides an improved system for displayingcontent in amusement park rides compared to conventional systems. As theLF display system 700 utilizes the LF display module 720 for generatingholographic content, the LF display module 720 may be used inreplacement of animatronic robots which are conventionally used inamusement park rides. Animatronic robots are costly to maintain and canat most present a single object (e.g., one character for the amusementpark ride). However, the LF display system 700 has the ability toprovide a range of holographic content. Moreover, the LF display system700 has easily maintainable components compared to the complex machineryof the animatronics used conventionally.

There are multiple configurations for LF display systems to beimplemented as a part of an amusement park ride. FIG. 8A is anillustration of such a LF display system 800 implemented as part of anamusement park ride presenting holographic content to one or moreviewers 805, in accordance to an embodiment. The LF display system 800is an embodiment of the LF display system 500. In some embodiments, theLF display system 800 is constructed as enclosure through which viewersare moved from one end to another. In one embodiment, the enclosure iscurved, e.g., “c” shaped, such that viewers enter the enclosure at anentrance 802 that is proximate to an exit 804 where they exit theenclosure. The LF display surface is curved in at least one dimension.In another embodiment, the LF display system 800 comprises at least onecurved wall forming a curved path for the one or more viewers 805 totraverse, and the curved wall comprises at least one curved LF displaysurface formed by the plurality of LF display modules that are tiledtogether to form a seamless surface environment. In another embodiment,the enclosure can be a straight corridor with multiple segments.Throughout the enclosure, the LF display system 800 provides holographiccontent to viewers. In LF display system 800, the amusement park's LFdisplay system 800 is a curved enclosure that includes an LF displayassembly with LF display modules throughout the enclosure (e.g., on allwalls, ceiling, and floor). The LF display system 800 may additionallyinclude other various components such as any of the components in the LFdisplay system 500. In one example, the LF display system 800 isconfigured to operate as a safari adventure providing holographiccontent corresponding to the safari adventure.

The LF display system 800 has a LF display assembly for providingholographic content to viewers of the amusement park ride. The LFdisplay system 800 moves one or more viewers through the enclosure toprovide holographic content to the viewers. The LF display system 800may move the viewers in various manners. In one embodiment, the LFdisplay system 800 may allow the viewers to freely move throughout theenclosure. In one example, the LF display system 800 may be akin to anexhibit where viewers may leisurely walk throughout the LF displaysystem 800 interacting with holographic content. In another embodiment,the LF display system 800 contains a user station that transportsviewers throughout the enclosure along a path. The vehicle may containone or more viewers and may be rigged with a sensory feedback systemsimilar to the user stations 615 of the LF display system 600. In someembodiments, the LF display assembly comprises LF display modules (e.g.,LF display modules 110 and 210) integrated on all walls, floor, andceiling of the enclosure. The LF display system 800 may augment portionsof the user station with holographic content in a manner similar to thatdescribed above in FIG. 6A with regard to the user stations 615. The LFdisplay system 800 may display holographic content viewable by allviewers with a direct line of sight or may display holographic contentviewable only be viewers within a portion of the viewing volume (e.g., asub-volume) of the LF display system 800. The LF display system 800 mayalso incorporate a sensory feedback system for providing other sensorystimuli to augment the holographic content provided by the LF displayassembly implemented throughout the enclosure.

In one embodiment, the LF display system 800 may virtually segment theenclosure by generating a holographic wall that effectively occludesportions of the enclosure to viewers. The LF display system 800 maycomprise a tracking system configured to track a location of each viewer805 within the viewing volume of the enclosure, and the presentedholographic content may include a first holographic object for a firstviewer within a first portion of the viewing volume (e.g., the firstsegment 806) and a second holographic object for a second viewer withina second portion of the viewing volume (e.g., the second segment 808).In this example, the first holographic object is presented within afirst portion of the holographic object volume that is visible from thefirst portion of the viewing volume and is not visible from the secondportion of the viewing volume. In other embodiments, the secondholographic object is presented within a second portion of theholographic object volume that is visible from the second portion of theviewing volume and is not visible from the first portion of the viewingvolume, and the first holographic object is different from the secondholographic object. In this example, the enclosure may allow multiplegroups of viewers to move through the enclosure together while beingable to present staged holographic content to each group. For example,the LF display assembly 800 can segment the enclosure into four segmentsby generating holographic walls and doors that intersect the enclosure.As one group of viewers moves into a first segment 806, a holographicwall shuts behind them. The viewers movement out of and into differentsegments is tracked by a tracking system (i.e., the tracking system580). During the time that the group of viewers can only viewholographic content presented within the first segment 806. Similarly,others outside of the first segment 806 would not be able to perceivethe holographic content presented within the first segment 806. Thenthat group of viewers may be shuttled to a second segment 808 whereanother holographic wall shuts behind them. At that time another groupof viewers may be moved into the first segment 806. In embodiments wherethe enclosure is circular, the groups of viewers may be timely movedfrom one portion of the enclosure to the next such that each group ofviewers cannot see the group ahead or the group behind because of thecurvature of the enclosure. Likewise, holographic content viewable byone group would not be viewable by another as the holographic contentwould not be in direct line of sight to the other group. For the safariexample, segments of the enclosure may be used to present holographicanimals or scenery for one location in the safari. Alternatively,segments of the enclosure may be used to present different herds ofholographic animals.

In another embodiment, the LF display system 800 comprises a trackingsystem (i.e., the tracking system 580) configured to track responses ofthe viewers 805. The tracking system may record viewer responses toholographic content within the amusement park ride. The LF displaysystem 800 comprises a viewer profiling module (i.e., the viewerprofiling module 528) configured to access the responses obtained by thetracking system, process the responses to identify a viewer of the oneor more viewers 805 of the amusement park ride, and generate a viewerprofile for the viewer. The controller of the LF display system 800 isconfigured to generate the holographic content for the viewer based inpart on the viewer profile. For example, in LF display system 800, asviewers pass through the first segment 806, the LF display system 800may record viewer responses. The LF display system 800 may furtheremploy, e.g., AI models including machine learning and/or neuralnetworks to develop viewer profiles that include preferences of theviewers. The LF display system 800 can generate new holographic contenttailored to the viewers according to the viewer responses and/or thelearned preferences. In an example of a haunted house, the LF displaysystem 800 may record a viewer's reaction to certain scary holographiccontent presented in the first segment 806. In the second segment 808,the LF display system 800 may continue or increase displaying of scaryholographic content that was highly effective in scaring (e.g., elicitsa loudest audible reaction as captured by an acoustic receiving deviceof the LF display system 800) the LF display system 800 will stop ordecrease displaying of other holographic content that was not aseffective in scaring the viewer. The LF display system 800 may furtherrecord viewer responses in viewer profiles that can be maintained fortailoring holographic content on subsequent visits to the amusement parkride.

In some embodiments where the enclosure is curved (e.g., circular), theLF display system 800 may provide an illusion of moving in a straightline when movement is actually along a curved path. The LF displaysystem 800 presents holographic content that includes a pathway for theone or more viewers 805 to traverse that has less curvature than acurvature of the at least one curved LF display surface. In thisexample, the LF display assembly of the LF display system 800 generatesholographic content to produce an illusion of moving in a straight linethrough the curved enclosure. The LF display assembly is an embodimentof the LF display assembly 510. The walls (and in some cases the ceilingand/or floor) of the curved enclosure are integrated with LF displaymodules which make up the LF display assembly. Depending on a curvatureof the curved enclosure, the LF display assembly may generateholographic content that skews to a certain amount the holographiccontent to compensate for the curvature. For example, although theenclosure bends due to the curvature, the holographic content presentedmay indicate a pathway that is more directly in front of the viewerrather than offset according to the curvature of the enclosure. Thecurvature of the enclosure can be determined to be below a thresholdamount, so that the illusion is more believable to viewers. As a result,the LF display assembly may trick viewers into imagining that the curvedenclosure is rather a straight enclosure.

In some embodiments where viewers are unconstrained (e.g., may freelyroam the enclosure), the LF display system 800 may redirect viewers fromcolliding with any physical objects. The LF display system 800 may usethe LF display assembly to redirect a viewer by generating holographiccontent that presents an obstacle. For the safari adventure example, theLF display assembly presents a holographic tree or rock on the safariadventure which would be undesirable for a viewer to proceed through thetree or rock. In another embodiment, the LF display system 800 may use asensory feedback system to redirect a viewer. As mentioned above indiscussion of sensory feedback system 570, the sensory feedback systemmay use sensory stimuli to redirect the viewer (e.g., audible signal ortactile acoustic pressure wave).

FIG. 8B is an illustration of a portion of the LF display system 800 ofFIG. 8A, in accordance with an embodiment. In one or more embodiments,the curved enclosure of the LF display system 800 may be a walkwayand/or a track for a user station. In one of these embodiments, theenclosure is simply a walkway and allows viewers to freely roam throughthe enclosure. In this example, the LF display system 800 may beconfigured as a haunted house where viewers walk themselves through theenclosure. In another embodiment, the enclosure may include a track fora user station to move through portions of the enclosure. The userstation may be substantially similar to the user station 615 describedabove with reference to FIG. 6A. In another embodiment, the user stationmay be a boat floating in a river that runs along a floor of theenclosure. In some cases, the river is holographic content, in otherembodiments, it is a physical waterway that moves through some or all ofthe enclosure. In the embodiment of FIG. 8B, the LF display system 800includes a user station 815 which moves the viewer through the enclosurein a first direction. The user station 815 can at least seat one or moreviewers and may include a frame or dashboard. The user station 815 maybe transformed with holographic content to appear differently (e.g., asa jeep in the safari adventure example). In additional configurations,the user station 815 may seat additional viewers. In some embodiments,viewers may exercise some control over the user station 815. The LFdisplay system 800 may generate a holographic dashboard which canreceive viewer input (via, e.g., a sensory feedback system 570, atracking system 580). The viewers may then start or stop the userstation 815 when desired. In the safari adventure example, the viewersmay choose when to stop their safari jeep to explore the surroundingholographic content. The amusement park ride may also deploy userstations at some frequency such that there is some separation from eachuser station 815. In some embodiments, the enclosure may comprisesegments with user stations on tracks and segments for walking around.In the safari adventure example, portions of the enclosure have userstations (e.g., user station 815) that appear as safari jeeps thattransport the viewer along the enclosure. In other portions theenclosure has no user station, and the viewer walks freely within thatportion. Some or all of the enclosure is covered with LF display modules820 (embodiments of the LF display module 110 and 210) for generatingholographic content including a holographic object 825 to viewers of theamusement park ride.

In one embodiment, the LF display system 800 generates varyingholographic content viewable by each of the viewers 805. In theseembodiments, the LF display system 800 may generate a holographic object825 viewable only by viewers 805 on the user station 815. Other viewers805 at a different portion of the LF display system 800 may be presentedwith other holographic content. This is an advantage to operating theamusement park ride as the amusement park ride can have multiple wavesof one or more viewers moving through the amusement park ride at anytime. Furthermore, being able to generate holographic content specificto each wave of viewers provides an easy manner of tailoring theamusement park ride to each wave of viewers. Conventional manners ofadjusting an amusement park ride may take hours or days to reprogram theamusement park ride. However, with the LF display system 800, theamusement park ride may easily adjust the holographic content providedto the viewers. Other conventional systems also incorporate physicaldécor and/or animatronics all along the enclosure. The physical décorand/or animatronics are difficult to maintain and not easilyinterchangeable. The LF display system 800 is better in that theholographic content can be easily rendered or adjusted. Likewise, the LFdisplay system 800 diminishes time and effort for maintenance andrepairs.

The LF display system 800 may also include a tracking system that trackspositions of viewers within the enclosure. The LF display system 800 maypresent one or more holographic objects that are customized to eachviewer based in part on the tracking information. In this manner,viewers that are at least a threshold distance from each other (e.g., acouple feet) are able to see completely different holographic content.For example, the LF display system 800 tracks a position of each of theviewers and determines perspectives of holographic objects that shouldbe visible to the viewers based on their tracked positions relative towhere the holographic objects would be presented. The LF display system800 selectively emits light from specific pixels of the LF displaymodules, the specific pixels corresponding to the determinedperspectives. Accordingly, different viewers that are close to eachother can simultaneously be presented with completely differentholographic content. For example, a viewer may be presented withholographic objects that are space related, whereas a different vieweris simultaneously being presented with holographic objects that aresafari related.

In some embodiments, the LF display system 800 may customize holographiccontent based in part on characteristics of the viewers. For example,the holographic content presented to the viewers may all share a commontheme (e.g., safari or space), but specific content may be adjustedbased in part of characteristics of the viewers. For example, an adultmay be presented with an R-rated version of lions killing buffalo,whereas a child is presented with a G-rated version. In contrast, forconventional systems to provide such individualized content wouldrequire the viewers to have individual AR/VR headsets.

Additional Configuration Information

The foregoing description of the embodiments of the disclosure has beenpresented for the purpose of illustration; it is not intended to beexhaustive or to limit the disclosure to the precise forms disclosed.Persons skilled in the relevant art can appreciate that manymodifications and variations are possible in light of the abovedisclosure.

Some portions of this description describe the embodiments of thedisclosure in terms of algorithms and symbolic representations ofoperations on information. These algorithmic descriptions andrepresentations are commonly used by those skilled in the dataprocessing arts to convey the substance of their work effectively toothers skilled in the art. These operations, while describedfunctionally, computationally, or logically, are understood to beimplemented by computer programs or equivalent electrical circuits,microcode, or the like. Furthermore, it has also proven convenient attimes, to refer to these arrangements of operations as modules, withoutloss of generality. The described operations and their associatedmodules may be embodied in software, firmware, hardware, or anycombinations thereof.

Any of the steps, operations, or processes described herein may beperformed or implemented with one or more hardware or software modules,alone or in combination with other devices. In one embodiment, asoftware module is implemented with a computer program productcomprising a computer-readable medium containing computer program code,which can be executed by a computer processor for performing any or allof the steps, operations, or processes described.

Embodiments of the disclosure may also relate to an apparatus forperforming the operations herein. This apparatus may be speciallyconstructed for the required purposes, and/or it may comprise ageneral-purpose computing device selectively activated or reconfiguredby a computer program stored in the computer. Such a computer programmay be stored in a non-transitory, tangible computer readable storagemedium, or any type of media suitable for storing electronicinstructions, which may be coupled to a computer system bus.Furthermore, any computing systems referred to in the specification mayinclude a single processor or may be architectures employing multipleprocessor designs for increased computing capability.

Embodiments of the disclosure may also relate to a product that isproduced by a computing process described herein. Such a product maycomprise information resulting from a computing process, where theinformation is stored on a non-transitory, tangible computer readablestorage medium and may include any embodiment of a computer programproduct or other data combination described herein.

Finally, the language used in the specification has been principallyselected for readability and instructional purposes, and it may not havebeen selected to delineate or circumscribe the inventive subject matter.It is therefore intended that the scope of the disclosure be limited notby this detailed description, but rather by any claims that issue on anapplication based hereon. Accordingly, the disclosure of the embodimentsis intended to be illustrative, but not limiting, of the scope of thedisclosure, which is set forth in the following claims.

1-69. (canceled)
 70. A light field (LF) display system comprising: acontroller configured to generate holographic content; a LF displayassembly comprising one or more LF display modules that are configuredto present the holographic content in a holographic object volume to oneor more viewers located in a viewing volume of the one or more LFdisplay modules of an amusement park ride; a tracking system comprisingone or more tracking devices configured to obtain information about theone or more viewers of the amusement park ride; and wherein thecontroller is configured to generate holographic content for the one ormore viewers of the amusement park ride based in part on the informationobtained by the tracking system.
 71. The LF display system of claim 70,wherein the information obtained by the tracking system includes any ofa position of the viewer, a movement of the viewer, a gesture of theviewer, an expression of the viewer, an age of the viewer, a gender ofthe viewer, and identification of a piece of a garment worn by theviewer.
 72. The LF display system of claim 70, wherein the controller isconfigured to use the information obtained by the tracking system and anartificial intelligence model to generate the holographic content. 73.The LF display system of claim 70, further comprising: a viewerprofiling module configured to: access the information obtained by thetracking system; process the information to identify a viewer of the oneor more viewers of the amusement park ride; and generate a viewerprofile for the viewer; and wherein the controller is configured togenerate the holographic content for the viewer based in part on theviewer profile.
 74. The LF display system of claim 73, wherein thecontroller is configured to use the viewer profile and an artificialintelligence model to generate the holographic content.
 75. The LFdisplay system of claim 73, wherein the viewer profiling module isfurther configured to: update the viewer profile using information froma social media account of the viewer; and wherein the controller isconfigured to generate the holographic content based in part on theupdated viewer profile.
 76. The LF display system of claim 75, whereinthe controller is configured to use the updated viewer profile and anartificial intelligence model to generate the holographic content. 77.The LF display system of claim 70, further comprising: a viewerprofiling module configured to: access the information obtained by thetracking system; process the information to identify the one or moreviewers of the amusement park ride; and generate an aggregate viewerprofile for the one or more viewers; and wherein the controller isconfigured to generate the holographic content for the one or moreviewers based in part on the aggregate viewer profile.
 78. The LFdisplay system of claim 77, wherein the viewer profiling module isfurther configured to: update the aggregate viewer profile usinginformation from at least one or more social media accounts of the oneor more viewers; and wherein the controller is configured to generateholographic content based in part on the updated aggregate viewerprofile.
 79. The LF display system of claim 70, further comprising: auser station configured to be occupied by the viewer and to moverelative to the one or more LF display modules, and wherein thecontroller is configured to generate holographic content based in parton relative movement between the user station and one or more LF displaymodules.
 80. The LF display system of claim 79, wherein the user stationis configured to move and the one or more LF display modules arestationary.
 81. The LF display system of claim 80, wherein the userstation includes at least one of a motor-controlled chair, amotor-controlled bench, a motor-controlled stool, a motor-controlledcart, a carriage, a vehicle, a motor-controlled floor, or amotor-controlled platform.
 82. The LF display system of claim 79,wherein the one or more LF display modules are configured to move andthe user station is stationary.
 83. The LF display system of claim 70,wherein the presented holographic content of the amusement park rideincludes a holographic character.
 84. The LF display system of claim 83,further comprising: a sensory feedback system comprising at least onesensory feedback device that is configured to provide sensory feedbackas the holographic character is presented.
 85. The LF display system ofclaim 84, wherein the sensory feedback includes tactile feedback, audiofeedback, aroma feedback, temperature feedback, or any combinationthereof.
 86. The LF display system of claim 85, wherein the tactilefeedback is configured to provide a tactile surface coincident with asurface of the holographic character that the one or more viewers mayinteract with via touch.
 87. The LF display system of claim 83, furthercomprising: a tracking system comprising one or more tracking devicesconfigured to obtain information about the one or more viewers of theamusement park ride; and wherein the controller is configured togenerate the holographic character for the one or more viewers of theamusement park ride based on the information obtained by the trackingsystem.
 88. The LF display system of claim 87, wherein the informationobtained by the tracking system includes any of: a position of theviewer, a movement of the viewer, a gesture of the viewer, an expressionof the viewer, a gaze of the viewer, an age of a viewer, a gender of theviewer, an identification of a piece of a garment worn by the viewer,and an auditory feedback of the viewer.
 89. The LF display system ofclaim 87, wherein the tracked information of the viewer includes thegaze of the viewer, and wherein the LF display assembly is configured toupdate eyes of the holographic character to maintain eye-contact withthe gaze of the viewer.
 90. The LF display system of claim 87, whereinthe one or more viewers include a first viewer and a second viewer andthe tracked response includes the gaze of the first viewer and thesecond viewer, and wherein the LF display assembly is configured toupdate eyes of the holographic character to alternate directingeye-contact between the first viewer and the second viewer.
 91. The LFdisplay system of claim 87, wherein the controller is configured to usethe information obtained by the tracking system and an artificialintelligence model to generate the holographic character.
 92. The LFdisplay system of claim 87, further comprising: a viewer profilingmodule configured to: access the information obtained by the trackingsystem; process the information to identify a viewer of the one or moreviewers of the amusement park ride; and generate a viewer profile forthe viewer, and wherein the controller is configured to generate theholographic character for the viewer based in part on the viewerprofile.
 93. The LF display system of claim 92, wherein the controlleris configured to use the viewer profile and an artificial intelligencemodel to generate the holographic character.
 94. The LF display systemof claim 92, wherein the viewer profiling module is further configuredto: update the viewer profile using information from a social mediaaccount of the viewer; and wherein the controller is configured togenerate the holographic character based in part on the updated viewerprofile.
 95. The LF display system of claim 94, wherein the controlleris configured to use the updated viewer profile and an artificialintelligence model to generate the holographic character.
 96. A lightfield (LF) display system comprising: a controller configured togenerate holographic content; a LF display assembly comprising one ormore LF display modules that are configured to present the holographiccontent in a holographic object volume to one or more viewers located ina viewing volume of the one or more LF display modules of an amusementpark ride; and an enclosure with at least one LF display surface formedby a plurality of LF display modules, the plurality of LF displaymodules including at least one of the one or more LF display modules,wherein the plurality of LF display modules are tiled together to form aseamless surface environment, and wherein the enclosure encloses theviewing volume for presenting holographic content to the one or moreviewers.
 97. The LF display system of claim 96, wherein the plurality ofLF display modules are coincident to a wall, a floor, a ceiling, or somecombination thereof.
 98. The LF display system of claim 96, wherein theholographic object volume extends behind a plane of the at least one LFdisplay surface such that holographic content creates a simulatedenvironment larger than the enclosure.
 99. The LF display system ofclaim 96, wherein the enclosure comprises: a user station that isconfigured to be occupied by the one or more viewers, wherein the userstation includes at least one of a chair, a bench, a stool, a cart, acarriage, a vehicle, a standing console, or some combination thereof;and a dashboard display surface of the user station, the dashboarddisplay surface comprising a LF display assembly, wherein the LF displayassembly presents at least one holographic object selected from theholographic content consisting of: a two-dimensional object, athree-dimensional object, a control button, a control switch, a controldial, a steering control interface, an instrument cluster, a volumecontrol interface, a computer interface, a shifter, some other controlinterface, or some combination thereof.
 100. The LF display system ofclaim 96, further comprising: a sensory feedback system comprising atleast one sensory feedback device that is configured to provide sensoryfeedback as the holographic content is presented, wherein the LF displayassembly is further configured to generate a tactile surface in a localarea of the LF display assembly.
 101. The LF display system of claim100, wherein the tactile surface is coincident with a surface of atleast one of the one or more holographic objects.
 102. The LF displaysystem of claim 96, further comprising: a tracking system comprising oneor more tracking devices configured to obtain information about the oneor more viewers of the amusement park ride; and wherein the controlleris configured to generate the holographic content for the one or moreviewers of the amusement park ride based on the information obtained bythe tracking system.
 103. The LF display system of claim 102, whereinthe information obtained by the tracking system includes any of aposition of the viewer, a movement of the viewer, a gesture of theviewer, an expression of the viewer, a gaze of the viewer, an age of aviewer, a gender of the viewer, an identification of a piece of agarment worn by the viewer, and an auditory feedback of the viewer. 104.The LF display system of claim 102, wherein the tracked information ofthe viewer includes the gaze of the viewer, and wherein the LF displayassembly is configured to perform an action based on the gesture. 105.The LF display system of claim 104, wherein the action comprisesadjusting a holographic object, adjusting a control interface, adjustingan arrangement of the one or more holographic objects, or somecombination thereof.
 106. The LF display system of claim 102, whereinthe tracking system is part of the LF display assembly, and the LFdisplay assembly includes at least one LF display module that has abidirectional LF display surface which simultaneously projectsholographic objects and senses light from a local area adjacent to theLF display surface.
 107. The LF display system of claim 102, wherein thecontroller is configured to use the information obtained by the trackingsystem and an artificial intelligence model to generate the holographiccontent.
 108. The LF display system of claim 102, further comprising: aviewer profiling module configured to: access the information obtainedby the tracking system; process the information to identify a viewer ofthe one or more viewers of the amusement park ride; and generate aviewer profile for the viewer, and wherein the controller is configuredto generate the holographic content for the viewer based in part on theviewer profile.
 109. The LF display system of claim 108, wherein thecontroller is configured to use the viewer profile and an artificialintelligence model to generate the holographic content.
 110. The LFdisplay system of claim 108, wherein the viewer profiling module isfurther configured to: update the viewer profile using information froma social media account of the viewer; and wherein the controller isconfigured to generate the holographic content based in part on theupdated viewer profile.
 111. The LF display system of claim 110, whereinthe controller is configured to use the updated viewer profile and anartificial intelligence model to generate the holographic content. 112.The LF display system of claim 96, further comprising: a tracking systemconfigured to track a location of each viewer within the viewing volumeof the enclosure; wherein the presented holographic content includes afirst holographic object for a first viewer within a first portion ofthe viewing volume and a second holographic object for a second viewerwithin a second portion of the viewing volume, and the first holographicobject is presented within a first portion of the holographic objectvolume that is visible from the first portion of the viewing volume andis not visible from the second portion of the viewing volume.
 113. TheLF display system of claim 112, wherein the second holographic object ispresented within a second portion of the holographic object volume thatis visible from the second portion of the viewing volume and is notvisible from the first portion of the viewing volume, and the firstholographic object is different from the second holographic object. 114.The LF display system of claim 96, further comprising: at least onecurved wall forming a curved path for the one or more viewers totraverse, and wherein the at least one curved wall comprises at leastone curved LF display surface formed by the plurality of LF displaymodules that are tiled together to form the seamless surfaceenvironment, the plurality of LF display modules including at least oneof the one or more LF display modules.
 115. The LF display system ofclaim 114, wherein the presented holographic content includes a pathwayfor the one or more viewers to traverse that has less curvature than acurvature of the at least one curved LF display surface.
 116. The LFdisplay system of claim 96, further comprising: an enclosure comprisinga first segment and a second segment that is adjacent to the firstsegment, wherein the first segment encloses a first portion of theviewing volume and a first portion of the holographic object volume,wherein the presented holographic content includes a first holographicobject for a first viewer within the first portion of the viewingvolume, and the first holographic object is presented within the firstportion of the holographic object volume and is not visible from thesecond portion of the viewing volume within the second segment.
 117. TheLF display system of claim 116, further comprising: a tracking systemconfigured to track responses of the viewer; a viewer profiling moduleconfigured to: access the responses obtained by the tracking system;process the responses to identify a viewer of the one or more viewers ofthe amusement park ride; and generate a viewer profile for the viewer;and wherein the controller is configured to generate the holographiccontent for the viewer based in part on the viewer profile.
 118. A lightfield (LF) display system comprising: a controller configured togenerate holographic content; a LF display assembly comprising one ormore LF display modules that are configured to the present holographiccontent in a holographic object volume to one or more viewers located ina viewing volume of the one or more LF display modules of an amusementpark queue; a tracking system configured to track responses of a viewerof the one or more viewers to the presented holographic content withinthe viewing volume; and wherein the controller is configured to updatethe presented holographic content based on the tracked responses. 119.The LF display system of claim 118, wherein the viewing volume includesa viewing sub-volume, and LF display modules present the holographiccontent to a viewer located in the viewing sub-volume, and the presentedholographic content is visible from inside the viewing sub-volume and isnot visible from outside the viewing sub-volume.
 120. The LF displaysystem of claim 118, wherein the tracked responses obtained by thetracking system includes any of a position of the viewer, a movement ofthe viewer, a gesture of the viewer, an expression of the viewer, a gazeof the viewer, and auditory feedback of the viewer.
 121. The LF displaysystem of claim 118, wherein the controller is configured to use theinformation obtained by the tracking system and an artificialintelligence model to generate the holographic content.
 122. The LFdisplay system of claim 118, wherein the holographic content presentedincludes a holographic character.
 123. The LF display system of claim122, wherein the tracked response of the viewer includes the gaze of theviewer, and wherein the LF display assembly is configured to update eyesof the holographic character to maintain eye-contact with the gaze ofthe viewer.
 124. The LF display system of claim 122, wherein the one ormore viewers include a first viewer and a second viewer and the trackedresponse includes the gaze of the first viewer and the second viewer,and wherein the LF display assembly is configured to update eyes of theholographic character to alternate directing eye-contact between thefirst viewer and the second viewer.
 125. The LF display system of claim118, further comprising: a viewer profiling module configured to:identify a viewer of the one or more viewers within the viewing volume,and generate a viewer profile for the viewer; and wherein the controlleris configured to generate the holographic content for the viewer basedin part on the viewer profile.
 126. The LF display system of claim 125,wherein the controller is configured to use the viewer profile and anartificial intelligence model to generate the holographic content. 127.The LF display system of claim 125, wherein the viewer profile includesinformation about the holographic content preferences of the viewer, thein-park purchases of the viewer, the status of the viewer, the frequencyof visiting each ride in the amusement park of the viewer, the waittimes of the viewer for each amusement park ride, the frequency betweenvisits to one particular ride in the amusement park of the viewer, orsome combination thereof.
 128. The LF display system of claim 125,wherein the presented holographic content includes personalizedholographic content, an amusement park ride suggestion, an amusementpark ride wait time, or some combination thereof.